-- Logs begin at Mon 2022-02-07 19:56:22 UTC, end at Mon 2022-02-07 20:51:47 UTC. -- Feb 07 20:22:12.985274 dv-cinder-828150-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 07 20:22:12.994326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 7 20:22:12 2022] *** Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: nodename: dv-cinder-828150-2-iscsi Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: machine: x86_64 Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: clock source: unix Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: pcre jit disabled Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: detected number of CPU cores: 4 Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: current working directory: / Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: detected binary path: /usr/bin/uwsgi-core Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: your processes number limit is 47680 Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: your memory page size is 4096 bytes Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: detected max file descriptor number: 2048 Feb 07 20:22:12.996326 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: lock engine: pthread robust mutexes Feb 07 20:22:12.997060 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: thunder lock: enabled Feb 07 20:22:12.997060 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 07 20:22:12.997060 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 07 20:22:13.041908 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: Python main interpreter initialized at 0x5641332e69c0 Feb 07 20:22:13.041908 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: python threads support enabled Feb 07 20:22:13.041908 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: your server socket listen backlog is limited to 100 connections Feb 07 20:22:13.041908 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: your mercy for graceful operations on workers is 90 seconds Feb 07 20:22:13.042289 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: mapped 403077 bytes (393 KB) for 2 cores Feb 07 20:22:13.042364 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: *** Operational MODE: preforking *** Feb 07 20:22:13.042608 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: *** uWSGI is running in multiple interpreter mode *** Feb 07 20:22:13.042608 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: spawned uWSGI master process (pid: 79136) Feb 07 20:22:13.042806 dv-cinder-828150-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 07 20:22:13.043347 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: spawned uWSGI worker 1 (pid: 79177, cores: 1) Feb 07 20:22:13.043693 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: spawned uWSGI worker 2 (pid: 79178, cores: 1) Feb 07 20:22:13.045299 dv-cinder-828150-2-iscsi devstack@keystone.service[79136]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 07 20:22:18.745470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 20:22:18.745470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: from cryptography.utils import int_from_bytes Feb 07 20:22:18.746283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 20:22:18.746283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: from cryptography.utils import int_from_bytes Feb 07 20:22:18.757304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 20:22:18.757304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: from cryptography.utils import int_from_bytes Feb 07 20:22:18.757767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 20:22:18.757767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: from cryptography.utils import int_from_bytes Feb 07 20:22:18.791673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 20:22:18.791862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 20:22:18.792052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] command line args: [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 20:22:18.792320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 20:22:18.792495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ================================================================================ {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 20:22:18.792747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] admin_token = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.792993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] config_dir = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.793180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.793362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] config_source = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.793541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] debug = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.793737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.794148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.794327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.794576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.794998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.795112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] list_limit = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.795229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] log_config_append = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.795412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.795593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] log_dir = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.795782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] log_file = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.795996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.796242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.796486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.796728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.796905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.797080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.797322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.797564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.797796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.798027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.798257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.798490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.798734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.798975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.799249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.799754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.799936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] publish_errors = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.800167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.800396 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.800575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.800821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.801007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 20:22:18.801143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.801268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 20:22:18.801390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] standard_threads = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.801510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] command line args: [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 20:22:18.801624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.801743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 20:22:18.801862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.801985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ================================================================================ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 20:22:18.802100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.802218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] admin_token = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.802340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] use_journal = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.802340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] use_json = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.802571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config_dir = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.802691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] use_stderr = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.802804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.802923 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] use_syslog = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.803042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config_source = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.803162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.803286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] debug = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.803286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.803554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.803670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.803790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.803922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.804043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.804163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.804276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.804396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.804511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.804635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.804749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.804862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_config_append = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.804974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.805093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.805093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_dir = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.805323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.805438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.805550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.805662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.805841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.805969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.806089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.806209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.806329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.806443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.806567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.806688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.806810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.806930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.807045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.807164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.807290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.807443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.807563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.807676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.807676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.807887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.808012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.808127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.808246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.808366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.808480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.808599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.808722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.808842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.808956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.809076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.809076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.809076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.809967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.809967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] publish_errors = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.810189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.810310 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.810436 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.810548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.810666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.810781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.810897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.811023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.811137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.811250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.811369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.811507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] standard_threads = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.811652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.811780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.811895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.812014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.812128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.812246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.812246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_journal = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.812479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.812593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_json = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.812706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.812820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_stderr = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.812932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.813051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_syslog = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.813172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.813286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 20:22:18.813400 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.813511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.813631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.813750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.813876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.813989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.814901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815605 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.815952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.816912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.817939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818404 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.818984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.819987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.820924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.821963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.822893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.823995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.824933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.825062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.825813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.825942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.826400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.826526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.826641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.826762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.826877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.826999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.827986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.828987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829575 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.829927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] auth.external = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.830882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] auth.password = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] auth.token = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.831974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832806 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.832929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] credential.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833387 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833860 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.833975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.834902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.835953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.836895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.837945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838761 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.838999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.external = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839484 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.839956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.password = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.token = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.840914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.841942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.842982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.843951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.844996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.845931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.846894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847711 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.847903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.848981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849392 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.849979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.850983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.851912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.852898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.853956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.854893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.855999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.856956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.857903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858019 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.858955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.859920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.860978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.861922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] role.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] role.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862869 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.862984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.863101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.863217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.863433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.863555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.863671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.863787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.863902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.864968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.865890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.866986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.867919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.868904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.869958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.870927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.871621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.871709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.871783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.871855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.871925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.872497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.872574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.872655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.872728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.872728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.872910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.873979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.874922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.connection = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.875905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876840 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.876964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.877898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.878947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.879704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.880540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.880540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.880540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.880540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.880970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.880970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.881189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.881376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.881609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.881854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.882153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.882418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.882668 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.882916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.883157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.883414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.883659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.883900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.884140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.884378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.884626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.884867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.885115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.885354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.885603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.885849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.886095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.886327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.886570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.886806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 20:22:18.886977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 20:22:18.909698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.909927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.910157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.913930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.914165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.914400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.918554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.922900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.946896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.947122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.949271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:18.949507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.000303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.000430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.050773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.051001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.051122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.051360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.116296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.116523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.116627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.116743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.116827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.116959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.117042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.117172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.117256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.117383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.117465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.117597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.142553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.142778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.142862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.143978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.144158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.155744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.156142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.168334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.168572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.168740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.168824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.169863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.170079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 20:22:19.186971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.187178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 20:22:19.187534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.187619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.187737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 20:22:19.187819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 20:22:19.188005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.188086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.188251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 20:22:19.188334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.188505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.188592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.188766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.188861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.189016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.189272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.199356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.199671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.199938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.200033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.200797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.201069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.201391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.202545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.209369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.210492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.212599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.212882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.213165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.213447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.213696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.213777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.213971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.214053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.214239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.214329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.214510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.214611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.214786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.214871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.215041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.215152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.215434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.215518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.215736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.216604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.216874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.217140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.241591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.242592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.243164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.243465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.244300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.244577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.248737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.249016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.249296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.249765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.250044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.250361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.256419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.256707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.257385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.257666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.261067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.261355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.261637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.261920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.262000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.262304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.262385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.263089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.263186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.263385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.263484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.263679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.263761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.263975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.264244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.264510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.282077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.282351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.282800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.283071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.286933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.287899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.290618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.290915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.291434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.291729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.296370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.297134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.299896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.300631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.303461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.303761 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.304047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.304293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.304440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.304591 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.304723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.304875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.305014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.305155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.305430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.305723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.323599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.323882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.324149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.324231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.324413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.324496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.324761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.325021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.332722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.333339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.334391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.334674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.334990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.335268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.337663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.337951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.338228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.338323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.338504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.338596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.338779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.338861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.339070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.339354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.351962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.352241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.352433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.352561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.352699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.352783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.352974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.353057 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.353252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.353342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.353535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.353617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.353807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.354078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.371031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.371528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.374913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.375223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.378172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.378449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.379777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.380040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.381367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.381627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.381709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.381901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.381984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.382178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.390857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.391637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.392501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.393221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.395652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.395942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.396233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.396350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.396520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.396638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.396926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.397204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.406355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.406635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.413952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.414324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.414625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.505478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.514053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.514337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.514617 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.514892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.515164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.515471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.515745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.516016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.516282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.516556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.516822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.517091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.517357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.517757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.520106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 20:22:19.520408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.520694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.520972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.521245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.521529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.521822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.522091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.522371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.522658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.522932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.523203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.523502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.523776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 20:22:19.554646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641332e69c0 pid: 79178 (default app) Feb 07 20:22:19.558004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d589-7499-4710-b004-2e380e672a10 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:19.558296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d589-7499-4710-b004-2e380e672a10 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:19.558573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d589-7499-4710-b004-2e380e672a10 None None] PATH_INFO: `/v3` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:19.561826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641332e69c0 pid: 79177 (default app) Feb 07 20:22:19.563272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Mon Feb 7 20:22:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:27.740439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1149a-c725-4bc0-bc10-a7efb4172113 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:27.740979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1149a-c725-4bc0-bc10-a7efb4172113 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:27.740979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1149a-c725-4bc0-bc10-a7efb4172113 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:27.746172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:27.751972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:27.752368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:27.752533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:27.783021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG oslo_db.sqlalchemy.engines [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 20:22:27.967991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG passlib.handlers.bcrypt [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79178) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 07 20:22:27.968406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG passlib.handlers.bcrypt [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79178) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 07 20:22:28.023352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:28.024906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:28.147274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:28.295299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1149a-c725-4bc0-bc10-a7efb4172113 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:28.328172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e1149a-c725-4bc0-bc10-a7efb4172113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 20:22:28.455239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1149a-c725-4bc0-bc10-a7efb4172113 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:28.459464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bc9c6-ea26-40bb-9ed8-323de304f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:28.460123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc9c6-ea26-40bb-9ed8-323de304f746 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:28.460407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc9c6-ea26-40bb-9ed8-323de304f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:28.460680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc9c6-ea26-40bb-9ed8-323de304f746 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:28.469196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc9c6-ea26-40bb-9ed8-323de304f746 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:28.519729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.common.rbac_enforcer.enforcer [None req-105bc9c6-ea26-40bb-9ed8-323de304f746 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 07 20:22:28.520072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc9c6-ea26-40bb-9ed8-323de304f746 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:28.529601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:22:28.535761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:28.550357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff44b8-79c8-4967-9c6f-73191ec0031d None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:28.554741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa296d-29c0-4efc-9c31-97005b4800f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:28.555866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa296d-29c0-4efc-9c31-97005b4800f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:28.556155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa296d-29c0-4efc-9c31-97005b4800f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:28.556434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa296d-29c0-4efc-9c31-97005b4800f6 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:28.557968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa296d-29c0-4efc-9c31-97005b4800f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:28.609151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28fa296d-29c0-4efc-9c31-97005b4800f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 07 20:22:28.609493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa296d-29c0-4efc-9c31-97005b4800f6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:28.614068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:28 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:30.777499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdbe15-1ae1-4bbf-8928-022ad76e0e6c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:30.778532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdbe15-1ae1-4bbf-8928-022ad76e0e6c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:30.778618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdbe15-1ae1-4bbf-8928-022ad76e0e6c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:30.783334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:30.788854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e7a-6cda-41ef-8539-76c64f8b6bcf None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:30.789216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e7a-6cda-41ef-8539-76c64f8b6bcf None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:30.789417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e7a-6cda-41ef-8539-76c64f8b6bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:30.808356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-574c8e7a-6cda-41ef-8539-76c64f8b6bcf None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:30.809907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-574c8e7a-6cda-41ef-8539-76c64f8b6bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:30.817624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:30.839267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdbe15-1ae1-4bbf-8928-022ad76e0e6c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:30.851769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdbe15-1ae1-4bbf-8928-022ad76e0e6c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:30.856603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb90a7f-adb7-4359-aa16-0ebd03ac554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:30.857235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb90a7f-adb7-4359-aa16-0ebd03ac554d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:30.857519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb90a7f-adb7-4359-aa16-0ebd03ac554d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:30.857796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb90a7f-adb7-4359-aa16-0ebd03ac554d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:30.866180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb90a7f-adb7-4359-aa16-0ebd03ac554d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:30.867994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb90a7f-adb7-4359-aa16-0ebd03ac554d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:30.876823 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:30.882319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c8e7a-6cda-41ef-8539-76c64f8b6bcf None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:30.891187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c8e7a-6cda-41ef-8539-76c64f8b6bcf None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:30.895600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae94340-08be-42c8-aaf1-727ffc41fff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:30.896450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94340-08be-42c8-aaf1-727ffc41fff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:30.896734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94340-08be-42c8-aaf1-727ffc41fff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:30.897011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae94340-08be-42c8-aaf1-727ffc41fff8 admin admin] PATH_INFO: `/v3/users/3b224356d3c840b79f4741c06d6f81d4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:30.898406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94340-08be-42c8-aaf1-727ffc41fff8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b224356d3c840b79f4741c06d6f81d4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:30.900269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae94340-08be-42c8-aaf1-727ffc41fff8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:30.901812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:30 2022] GET /identity/v3/users/3b224356d3c840b79f4741c06d6f81d4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:33.148085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751a7e-8add-4a5d-837a-70fe756b6368 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.148579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751a7e-8add-4a5d-837a-70fe756b6368 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.148660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9751a7e-8add-4a5d-837a-70fe756b6368 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.150392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:33.156531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de12fc-f5e3-4cfb-b8b2-9b51ba4828c4 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.156954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de12fc-f5e3-4cfb-b8b2-9b51ba4828c4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.157118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de12fc-f5e3-4cfb-b8b2-9b51ba4828c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.174921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-63de12fc-f5e3-4cfb-b8b2-9b51ba4828c4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:33.176128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-63de12fc-f5e3-4cfb-b8b2-9b51ba4828c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:33.183690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 6/11] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:33.203220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e6b2-9b57-4ade-8067-1b3e9fedd72a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.203542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e6b2-9b57-4ade-8067-1b3e9fedd72a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.203826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e6b2-9b57-4ade-8067-1b3e9fedd72a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.205544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 6/12] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:33.207244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de12fc-f5e3-4cfb-b8b2-9b51ba4828c4 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:33.210370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.210663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.210947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.217167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de12fc-f5e3-4cfb-b8b2-9b51ba4828c4 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:33.221482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:33.222252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.222536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.222817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.235421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:33.242119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:22:33.243284 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 7/13] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:22:33.248830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:33.252261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG passlib.handlers.bcrypt [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79177) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 07 20:22:33.252687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG passlib.handlers.bcrypt [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79177) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 07 20:22:33.257989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba48323-180e-4d56-a6d4-2a170ccb634e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:33.262766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:33.263367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.263676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.263948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.264695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:33.265000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:33.266752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:33.266752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:22:33.266752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:22:33.267682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:33.280593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 8/14] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:33.286035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:33.294790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b702f1-f6c8-4d92-ba42-7236e14a541a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:33.299011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:33.299819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.299912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:33.300103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.300377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] PATH_INFO: `/v3/users/3b224356d3c840b79f4741c06d6f81d4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.301432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:33.301529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] RBAC: Authorizing `identity:get_user(user_id=3b224356d3c840b79f4741c06d6f81d4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:33.303285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:33.304778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 9/15] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:33 2022] GET /identity/v3/users/3b224356d3c840b79f4741c06d6f81d4 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:33.309387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:33.318518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01340b76-87a7-4f04-a36f-7df12115436a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:33.322967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:33.323343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 7/16] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:33.323877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.324226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.324570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.326292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:33.328114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:33.329689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 10/17] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:33.334807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:33.344610 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b261ccb-1eb1-4132-93ea-086d8cf500ba None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:33.345467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:33.348939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:33.349903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.350191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.350479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.351523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.domain.id=default, user.id=3b224356d3c840b79f4741c06d6f81d4) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:33.351841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:33.353601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:33.353601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:22:33.353601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:22:33.354720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090f46-9ae3-405e-9247-51a19cce1ec9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:33.354818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:33.359161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48064dbf-6b02-463f-ac9f-2e5278babde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:33.359795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48064dbf-6b02-463f-ac9f-2e5278babde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.360078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48064dbf-6b02-463f-ac9f-2e5278babde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.360354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48064dbf-6b02-463f-ac9f-2e5278babde6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.364158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 8/18] 10.222.0.60 () {56 vars in 1343 bytes} [Mon Feb 7 20:22:33 2022] GET /identity/v3/role_assignments?user.id=3b224356d3c840b79f4741c06d6f81d4&scope.domain.id=default&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:33.368879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48064dbf-6b02-463f-ac9f-2e5278babde6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:33.370678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48064dbf-6b02-463f-ac9f-2e5278babde6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:33.380860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 11/19] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:22:33.386636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:33.397338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862ede-f92b-4546-bfe3-37377800825a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:33.401977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433da5d-5ab4-4585-8923-433f0fb72d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:33.402728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433da5d-5ab4-4585-8923-433f0fb72d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:33.403624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433da5d-5ab4-4585-8923-433f0fb72d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:33.403903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433da5d-5ab4-4585-8923-433f0fb72d44 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:33.405352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433da5d-5ab4-4585-8923-433f0fb72d44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:33.407358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433da5d-5ab4-4585-8923-433f0fb72d44 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:33.409393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 9/20] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:35.923735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb8ed-2fd6-4f78-a5df-659476dfa5d1 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:35.924262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb8ed-2fd6-4f78-a5df-659476dfa5d1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:35.924338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb8ed-2fd6-4f78-a5df-659476dfa5d1 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:35.926691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 12/21] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:35.931729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268d38-81d5-4be7-b82a-3c4c6fa4b56b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:35.932559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268d38-81d5-4be7-b82a-3c4c6fa4b56b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:35.933069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268d38-81d5-4be7-b82a-3c4c6fa4b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:35.959554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cf268d38-81d5-4be7-b82a-3c4c6fa4b56b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:35.961109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cf268d38-81d5-4be7-b82a-3c4c6fa4b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:35.975215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 10/22] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:36.010835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a3e8-fc39-4db7-977e-c2984aed29ab None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.011124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a3e8-fc39-4db7-977e-c2984aed29ab None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.011603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a3e8-fc39-4db7-977e-c2984aed29ab None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.013814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 13/23] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:36.013998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268d38-81d5-4be7-b82a-3c4c6fa4b56b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.024365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268d38-81d5-4be7-b82a-3c4c6fa4b56b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.030218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f339c-1fc4-4223-9c31-d727da60e8c2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.030903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f339c-1fc4-4223-9c31-d727da60e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.031766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f339c-1fc4-4223-9c31-d727da60e8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.034416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.035224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.035557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.035842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.053415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-798f339c-1fc4-4223-9c31-d727da60e8c2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:36.054933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-798f339c-1fc4-4223-9c31-d727da60e8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:36.066831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 14/24] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:36.068229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.070131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.095973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:22:36.102005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 11/25] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:36.103480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f339c-1fc4-4223-9c31-d727da60e8c2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.114116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f339c-1fc4-4223-9c31-d727da60e8c2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.118916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.123956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.124471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.124974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.125951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:36.126457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.127716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:36.127716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:22:36.127716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:22:36.128943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.135227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.146462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62680cd3-fef2-4c3d-bbd5-ea055440d71d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.157304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 15/26] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:36.162478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.162942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.163978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.164411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.164836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.174099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3376-d118-479d-8540-d9d1ab8edf8f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.183825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.185281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.185688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.186066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.186894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.188154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:36.188154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:22:36.188154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:22:36.189737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.190849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:36.206224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:22:36.208156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 12/27] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:22:36.213691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.229316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b183282-56b3-485b-b636-f27f294006a8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.242849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.243816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.244275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.244704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.245640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:36.246093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.247872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:36.247872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:22:36.247872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:22:36.249068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.271717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:36.272812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.289209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b640c-da2d-47ae-aae1-30a151314588 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.304947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.306045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.306480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.306904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] PATH_INFO: `/v3/users/3b224356d3c840b79f4741c06d6f81d4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.312343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b224356d3c840b79f4741c06d6f81d4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.314358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.316534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 14/29] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:36 2022] GET /identity/v3/users/3b224356d3c840b79f4741c06d6f81d4 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:36.321284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.331365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c32f40-c16b-49bd-99f9-f8b32d660701 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.346446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 16/30] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:22:36 2022] POST /identity/v3/projects => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:22:36.346604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ba692-875e-4d1a-9aa7-f6049ccee3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.347424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ba692-875e-4d1a-9aa7-f6049ccee3fa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.347644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ba692-875e-4d1a-9aa7-f6049ccee3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.347930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ba692-875e-4d1a-9aa7-f6049ccee3fa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.349280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ba692-875e-4d1a-9aa7-f6049ccee3fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.351096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ba692-875e-4d1a-9aa7-f6049ccee3fa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.353298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 15/31] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:36.359995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.370336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13e07-d9c7-4bd2-962d-4282fc78cb25 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.370632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13e07-d9c7-4bd2-962d-4282fc78cb25 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.370973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b13e07-d9c7-4bd2-962d-4282fc78cb25 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.373592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 16/32] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:36.396070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba911a6-22bd-4180-b3e3-423fa3e7755c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.396421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba911a6-22bd-4180-b3e3-423fa3e7755c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.396648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba911a6-22bd-4180-b3e3-423fa3e7755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.428384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e12e9-df45-43ea-9d07-7a8ab6bb6c4e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.441153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5838ba9-f2cd-496b-ae8f-1e4a88891672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.442070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5838ba9-f2cd-496b-ae8f-1e4a88891672 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.442359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5838ba9-f2cd-496b-ae8f-1e4a88891672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.442456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2ba911a6-22bd-4180-b3e3-423fa3e7755c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:36.442650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5838ba9-f2cd-496b-ae8f-1e4a88891672 admin admin] PATH_INFO: `/v3/domains/default/users/3b224356d3c840b79f4741c06d6f81d4/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.443767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2ba911a6-22bd-4180-b3e3-423fa3e7755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:36.444951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5838ba9-f2cd-496b-ae8f-1e4a88891672 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3b224356d3c840b79f4741c06d6f81d4, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.446195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-b5838ba9-f2cd-496b-ae8f-1e4a88891672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:36.446195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:22:36.446195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:22:36.448219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5838ba9-f2cd-496b-ae8f-1e4a88891672 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.463712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 17/33] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:36.469926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 17/34] 10.222.0.60 () {58 vars in 1382 bytes} [Mon Feb 7 20:22:36 2022] PUT /identity/v3/domains/default/users/3b224356d3c840b79f4741c06d6f81d4/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:22:36.504899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba911a6-22bd-4180-b3e3-423fa3e7755c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:36.519661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba911a6-22bd-4180-b3e3-423fa3e7755c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:36.628182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c8703-93a5-4c9a-a2c9-06d563400533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:36.628895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c8703-93a5-4c9a-a2c9-06d563400533 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.629246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c8703-93a5-4c9a-a2c9-06d563400533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.629530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c8703-93a5-4c9a-a2c9-06d563400533 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.630378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c8703-93a5-4c9a-a2c9-06d563400533 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:36.631430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-6c2c8703-93a5-4c9a-a2c9-06d563400533 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:36.631430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:22:36.631430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:22:36.632368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c8703-93a5-4c9a-a2c9-06d563400533 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:36.782510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 18/35] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:22:36 2022] POST /identity/v3/roles => generated 219 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:36.917640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fbdae-87e2-423b-ab1a-2f45d18e4f22 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.917931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fbdae-87e2-423b-ab1a-2f45d18e4f22 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.918974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fbdae-87e2-423b-ab1a-2f45d18e4f22 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.921249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 18/36] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:36.926924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08753ca1-f0d5-4f46-a148-19e46a218fb4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:36.927613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08753ca1-f0d5-4f46-a148-19e46a218fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:36.928102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08753ca1-f0d5-4f46-a148-19e46a218fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:36.953762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-08753ca1-f0d5-4f46-a148-19e46a218fb4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:36.956179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-08753ca1-f0d5-4f46-a148-19e46a218fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:36.969257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 19/37] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:36.993216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fbdae-87e2-423b-ab1a-2f45d18e4f22 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:37.013119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fbdae-87e2-423b-ab1a-2f45d18e4f22 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:37.018566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a78fff-1119-4a99-9dfd-5bf2f75dea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:37.019258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78fff-1119-4a99-9dfd-5bf2f75dea2b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.019548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78fff-1119-4a99-9dfd-5bf2f75dea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.019830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a78fff-1119-4a99-9dfd-5bf2f75dea2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.020606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78fff-1119-4a99-9dfd-5bf2f75dea2b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:37.021626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-d7a78fff-1119-4a99-9dfd-5bf2f75dea2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:37.021626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:22:37.021626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:22:37.022544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a78fff-1119-4a99-9dfd-5bf2f75dea2b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:37.045756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 19/38] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:22:36 2022] POST /identity/v3/roles => generated 225 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:37.436365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17aba7-1e27-4e99-bba9-93fcf5a97b2c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.436682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17aba7-1e27-4e99-bba9-93fcf5a97b2c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.437043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17aba7-1e27-4e99-bba9-93fcf5a97b2c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.438968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 20/39] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:37.444023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f59e5-ea3e-4a59-bd9c-a14cc4c150f6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.444319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f59e5-ea3e-4a59-bd9c-a14cc4c150f6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.444600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f59e5-ea3e-4a59-bd9c-a14cc4c150f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.462704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-503f59e5-ea3e-4a59-bd9c-a14cc4c150f6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:37.464220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-503f59e5-ea3e-4a59-bd9c-a14cc4c150f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:37.471844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 20/40] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:37.496047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17aba7-1e27-4e99-bba9-93fcf5a97b2c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:37.509363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17aba7-1e27-4e99-bba9-93fcf5a97b2c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:37.514535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf2f20-2aec-4d58-9d83-2ea7ef3ee466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:37.515225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2f20-2aec-4d58-9d83-2ea7ef3ee466 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.515556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2f20-2aec-4d58-9d83-2ea7ef3ee466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.515841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf2f20-2aec-4d58-9d83-2ea7ef3ee466 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.516638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf2f20-2aec-4d58-9d83-2ea7ef3ee466 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:37.518517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf2f20-2aec-4d58-9d83-2ea7ef3ee466 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:37.534032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 21/41] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:22:37 2022] POST /identity/v3/roles => generated 223 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:37.778148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee41bd8-e568-4fd5-8bca-3946e4a03144 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.778370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee41bd8-e568-4fd5-8bca-3946e4a03144 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.778648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee41bd8-e568-4fd5-8bca-3946e4a03144 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.780454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 21/42] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:37.785920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a343c67-9fce-4b56-9b29-88907ebcbe25 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.786209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a343c67-9fce-4b56-9b29-88907ebcbe25 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.786488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a343c67-9fce-4b56-9b29-88907ebcbe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.804232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9a343c67-9fce-4b56-9b29-88907ebcbe25 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:37.805392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9a343c67-9fce-4b56-9b29-88907ebcbe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:37.813509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 22/43] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:37.836066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee41bd8-e568-4fd5-8bca-3946e4a03144 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:37.847958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee41bd8-e568-4fd5-8bca-3946e4a03144 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:37.852222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9390a-d1c4-432c-a1d1-3eba31ee1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:37.852997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9390a-d1c4-432c-a1d1-3eba31ee1020 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.853281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9390a-d1c4-432c-a1d1-3eba31ee1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.853558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9390a-d1c4-432c-a1d1-3eba31ee1020 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.854730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9390a-d1c4-432c-a1d1-3eba31ee1020 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:37.856975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9390a-d1c4-432c-a1d1-3eba31ee1020 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:37.858537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 22/44] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:37.863993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a343c67-9fce-4b56-9b29-88907ebcbe25 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:37.873201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a343c67-9fce-4b56-9b29-88907ebcbe25 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:37.877635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518b32b-dae3-4982-a87f-e932779513d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:37.878293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b32b-dae3-4982-a87f-e932779513d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:37.878583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b32b-dae3-4982-a87f-e932779513d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:37.878868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b32b-dae3-4982-a87f-e932779513d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:37.879643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518b32b-dae3-4982-a87f-e932779513d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:37.880680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-a518b32b-dae3-4982-a87f-e932779513d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:37.880680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:22:37.880680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:22:37.881895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518b32b-dae3-4982-a87f-e932779513d1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:37.923434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:22:37 2022] POST /identity/v3/projects => generated 312 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:22:39.075257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d045-e0d7-473a-b691-d31822625731 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:39.075791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d045-e0d7-473a-b691-d31822625731 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:39.075870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d045-e0d7-473a-b691-d31822625731 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:39.077616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 23/46] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:39.082912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476102c-33bf-4799-98c7-a4a73ba0e670 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:39.083330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476102c-33bf-4799-98c7-a4a73ba0e670 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:39.083536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476102c-33bf-4799-98c7-a4a73ba0e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:39.101305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4476102c-33bf-4799-98c7-a4a73ba0e670 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:39.102513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4476102c-33bf-4799-98c7-a4a73ba0e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:39.158240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 24/47] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:39.182171 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27d045-e0d7-473a-b691-d31822625731 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:39.194688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27d045-e0d7-473a-b691-d31822625731 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:39.198935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:39.200315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:39.200606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:39.200889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:39.210702 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:39.217536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:22:39.218684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 24/48] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:39.224038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476102c-33bf-4799-98c7-a4a73ba0e670 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:39.233347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476102c-33bf-4799-98c7-a4a73ba0e670 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:39.237756 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:39.238417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:39.238711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:39.239002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:39.239812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:39.240129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:39.241760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:39.250365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:39.255378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:39.265211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4afbc-8783-4337-b90f-90d23f567037 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:39.269569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:39.270387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:39.270674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:39.270956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] PATH_INFO: `/v3/users/3b224356d3c840b79f4741c06d6f81d4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:39.272197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b224356d3c840b79f4741c06d6f81d4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:39.274011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:39.275577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:39 2022] GET /identity/v3/users/3b224356d3c840b79f4741c06d6f81d4 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:39.280438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:39.289924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493eb18-3d74-456d-a057-5f24de5faa12 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:39.294865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393db142-fa36-44e2-8739-e98e75168d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:39.295650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db142-fa36-44e2-8739-e98e75168d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:39.295943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db142-fa36-44e2-8739-e98e75168d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:39.296227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db142-fa36-44e2-8739-e98e75168d89 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:39.297421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393db142-fa36-44e2-8739-e98e75168d89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:39.299110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393db142-fa36-44e2-8739-e98e75168d89 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:39.300675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 26/51] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:39.305788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:39.316009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32688d6a-849c-4f39-9dfe-8addaeb321e5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:39.320391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:39.321005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:39.321290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:39.321570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:39.322406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.domain.id=default, user.id=3b224356d3c840b79f4741c06d6f81d4) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:39.322720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:39.323747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:39.323747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:22:39.323747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:22:39.324914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6028bee-b8a3-4fd9-95e5-dca22d5fca4f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:39.331834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 26/52] 10.222.0.60 () {56 vars in 1343 bytes} [Mon Feb 7 20:22:39 2022] GET /identity/v3/role_assignments?user.id=3b224356d3c840b79f4741c06d6f81d4&scope.domain.id=default&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:40.110412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793f52-f979-43c1-9bd0-c620327ac9cd None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:40.110914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793f52-f979-43c1-9bd0-c620327ac9cd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:40.110997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81793f52-f979-43c1-9bd0-c620327ac9cd None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:40.112766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 27/53] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:40.117831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca653-5d9d-4937-8691-10357c096d0a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:40.118229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca653-5d9d-4937-8691-10357c096d0a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:40.118395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca653-5d9d-4937-8691-10357c096d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:40.136364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-221ca653-5d9d-4937-8691-10357c096d0a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:40.137578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-221ca653-5d9d-4937-8691-10357c096d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:40.145138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 27/54] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:40.168022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81793f52-f979-43c1-9bd0-c620327ac9cd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:40.180199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81793f52-f979-43c1-9bd0-c620327ac9cd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:40.184922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6539551-d01f-4b50-a613-b458cb61e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:40.185683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6539551-d01f-4b50-a613-b458cb61e3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:40.185969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6539551-d01f-4b50-a613-b458cb61e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:40.186247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6539551-d01f-4b50-a613-b458cb61e3f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:40.187442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6539551-d01f-4b50-a613-b458cb61e3f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:40.189144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6539551-d01f-4b50-a613-b458cb61e3f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:40.190667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:40.195612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca653-5d9d-4937-8691-10357c096d0a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:40.204236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca653-5d9d-4937-8691-10357c096d0a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:40.208542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340bf28-9d0b-4098-8bd3-289cd22838cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:40.209175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340bf28-9d0b-4098-8bd3-289cd22838cc admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:40.209461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340bf28-9d0b-4098-8bd3-289cd22838cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:40.209742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340bf28-9d0b-4098-8bd3-289cd22838cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:40.210452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340bf28-9d0b-4098-8bd3-289cd22838cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:40.212408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340bf28-9d0b-4098-8bd3-289cd22838cc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:40.237563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 28/56] 10.222.0.60 () {60 vars in 1161 bytes} [Mon Feb 7 20:22:40 2022] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:42.412613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae892c09-9729-45e1-b03c-ffad4db17fad None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:42.413124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae892c09-9729-45e1-b03c-ffad4db17fad None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:42.413396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae892c09-9729-45e1-b03c-ffad4db17fad None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:42.415172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 29/57] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:42.420496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda52d-df67-41b3-b884-2722ff848291 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:42.420872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda52d-df67-41b3-b884-2722ff848291 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:42.421069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda52d-df67-41b3-b884-2722ff848291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:42.438125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-70dda52d-df67-41b3-b884-2722ff848291 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:42.439775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-70dda52d-df67-41b3-b884-2722ff848291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:42.493554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 29/58] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:42.517929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae892c09-9729-45e1-b03c-ffad4db17fad None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:42.530181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae892c09-9729-45e1-b03c-ffad4db17fad None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:42.534597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192d590-2909-4e2b-829f-8d0a5934c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:42.536316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192d590-2909-4e2b-829f-8d0a5934c3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:42.536605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192d590-2909-4e2b-829f-8d0a5934c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:42.536884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192d590-2909-4e2b-829f-8d0a5934c3ca admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:42.538054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192d590-2909-4e2b-829f-8d0a5934c3ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:42.539768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192d590-2909-4e2b-829f-8d0a5934c3ca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:42.541294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 30/59] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:42.546281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda52d-df67-41b3-b884-2722ff848291 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:42.554901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda52d-df67-41b3-b884-2722ff848291 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:42.560987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731376af-ab8e-40a8-b6e5-85076a3475a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:42.561640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731376af-ab8e-40a8-b6e5-85076a3475a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:42.561922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731376af-ab8e-40a8-b6e5-85076a3475a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:42.562197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731376af-ab8e-40a8-b6e5-85076a3475a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:42.562925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731376af-ab8e-40a8-b6e5-85076a3475a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:42.563966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-731376af-ab8e-40a8-b6e5-85076a3475a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:42.563966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:22:42.563966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:22:42.565168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731376af-ab8e-40a8-b6e5-85076a3475a8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:42.591283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 30/60] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:22:42 2022] POST /identity/v3/users => generated 275 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:45.925249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14881-764a-4a4e-ab1c-98d7cedf6634 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:45.926251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14881-764a-4a4e-ab1c-98d7cedf6634 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:45.926726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14881-764a-4a4e-ab1c-98d7cedf6634 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:45.929032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 31/61] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:45.934445 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8815-8e5a-4b9d-9171-69f1f25887b6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:45.935278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8815-8e5a-4b9d-9171-69f1f25887b6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:45.935788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e8815-8e5a-4b9d-9171-69f1f25887b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:45.960411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-962e8815-8e5a-4b9d-9171-69f1f25887b6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:45.961969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-962e8815-8e5a-4b9d-9171-69f1f25887b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:45.970265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 31/62] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:45.994177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14881-764a-4a4e-ab1c-98d7cedf6634 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.013851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14881-764a-4a4e-ab1c-98d7cedf6634 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.024578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.025649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.026144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.026634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.041509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:46.047138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd059-6334-42ea-ac3b-0375c2fcca95 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.047708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd059-6334-42ea-ac3b-0375c2fcca95 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.048219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd059-6334-42ea-ac3b-0375c2fcca95 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.050215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 32/63] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:46.054097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:22:46.055114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d28902-f2fb-4fe0-bb11-4f02356f0f7f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.055657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d28902-f2fb-4fe0-bb11-4f02356f0f7f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.055831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 32/64] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:46.056152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d28902-f2fb-4fe0-bb11-4f02356f0f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.063040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.074083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfb7c1-0d63-4578-8fb0-2ddfafa1cf56 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.082623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74549526-421f-4bab-8b2a-47ff1c25aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.083367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74549526-421f-4bab-8b2a-47ff1c25aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.083688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74549526-421f-4bab-8b2a-47ff1c25aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.083973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74549526-421f-4bab-8b2a-47ff1c25aa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.084444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-b2d28902-f2fb-4fe0-bb11-4f02356f0f7f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:46.084766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74549526-421f-4bab-8b2a-47ff1c25aa4e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.085082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74549526-421f-4bab-8b2a-47ff1c25aa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.086280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b2d28902-f2fb-4fe0-bb11-4f02356f0f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:46.086713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74549526-421f-4bab-8b2a-47ff1c25aa4e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.095358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 33/65] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:46.096960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129b48-032e-4483-aefd-7bb6629ee008 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.097459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129b48-032e-4483-aefd-7bb6629ee008 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.097942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129b48-032e-4483-aefd-7bb6629ee008 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.100125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 34/66] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:46.100553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 33/67] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:46.105894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129b48-032e-4483-aefd-7bb6629ee008 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.118405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129b48-032e-4483-aefd-7bb6629ee008 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.119336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f5b22-dca9-491a-8154-0a94a9b51995 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.119669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f5b22-dca9-491a-8154-0a94a9b51995 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.119956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f5b22-dca9-491a-8154-0a94a9b51995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.123850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.124995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.125481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.126036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.141298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.144175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.146373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 35/68] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.146973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ab0f5b22-dca9-491a-8154-0a94a9b51995 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:46.147511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.148682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ab0f5b22-dca9-491a-8154-0a94a9b51995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:46.161059 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 34/69] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:46.162259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f5b22-dca9-491a-8154-0a94a9b51995 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.170213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7bda-1c5a-48c5-a58c-833e490a8db5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.173072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f5b22-dca9-491a-8154-0a94a9b51995 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.178139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.179132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.179660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.180152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.185126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.185952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.186398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.186830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.191284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.193334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.205746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:46.207767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 35/70] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:46.208658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.213932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:22:46.216408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 36/71] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:46.218548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c786dc-6b21-49a0-916e-0b6e7eeed79d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.221839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.223770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.224776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.225208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.225630 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.232520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe695f2-be29-4f1c-8a50-6bd0061ea449 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.237136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.237457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:46.238155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.238540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.238915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.240262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.242481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.244274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.245224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.245518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:22:46.248616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:46.252281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.263242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ac956-5257-4cc4-a1e2-0077110cf49a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.267233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f4e07-552c-4d8f-a35e-0fca5377e6a1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.268381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.269292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.269794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.270266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.271227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.271839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.272125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.272478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.272763 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.273043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.273895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=71fa9aea79124087a13788fd2ea8d178) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.274207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.275057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.276089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.282951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/role_assignments?user.id=71fa9aea79124087a13788fd2ea8d178&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.285229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 38/75] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.292427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.293914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.311973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9435-c7ed-4243-ad37-064f8d760581 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.315372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340cfcb-ee2f-4c7d-9f19-4012eedc4597 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.323373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.324828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.325128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.325410 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.327202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.329514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.331289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.332098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.332783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.333071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.333351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.334141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.334456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.336149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.338469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.351888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 38/77] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.360514 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.360974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45201fa-de6e-45cc-a756-4889fcc53800 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.373531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290debf-a967-48f1-b7b5-05d939cef1b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.375593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.376213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.376503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.376788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.389212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.391125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.396278 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.397200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.397491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.397778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] PATH_INFO: `/v3/users/3b224356d3c840b79f4741c06d6f81d4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.399286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b224356d3c840b79f4741c06d6f81d4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.401225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.403053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/users/3b224356d3c840b79f4741c06d6f81d4 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.412504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.413711 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 40/79] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:46.419773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.425231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5f202-881b-4dec-b31a-bbf71790dfb9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.439428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3a86-8138-486b-bd8a-e2dcda700b85 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.439627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a28b3a-c701-48b9-b29f-8a2013ac1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.439627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28b3a-c701-48b9-b29f-8a2013ac1479 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.439627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28b3a-c701-48b9-b29f-8a2013ac1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.439627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28b3a-c701-48b9-b29f-8a2013ac1479 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.439920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55780a1-3472-41e7-a119-0e400329edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.439920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55780a1-3472-41e7-a119-0e400329edb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.439920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55780a1-3472-41e7-a119-0e400329edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.439920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55780a1-3472-41e7-a119-0e400329edb6 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.440479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a28b3a-c701-48b9-b29f-8a2013ac1479 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.441361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55780a1-3472-41e7-a119-0e400329edb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.442295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a28b3a-c701-48b9-b29f-8a2013ac1479 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.443893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55780a1-3472-41e7-a119-0e400329edb6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.445868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 41/80] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:46.447590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd6f5-42ea-4aa8-89b8-26fd02f61494 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.448064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd6f5-42ea-4aa8-89b8-26fd02f61494 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.448487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd6f5-42ea-4aa8-89b8-26fd02f61494 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.457064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 42/81] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:46.457550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd6f5-42ea-4aa8-89b8-26fd02f61494 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.467170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 40/82] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:46.467170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544791-dc7c-4c63-b075-2dd0800655bb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.467170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544791-dc7c-4c63-b075-2dd0800655bb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.467170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77544791-dc7c-4c63-b075-2dd0800655bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.478445 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd6f5-42ea-4aa8-89b8-26fd02f61494 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.482866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.484113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.484113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.484113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.485277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] RBAC: Adding query filter params (role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=71fa9aea79124087a13788fd2ea8d178) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.485277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.487474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.490777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-77544791-dc7c-4c63-b075-2dd0800655bb None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:46.492591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-77544791-dc7c-4c63-b075-2dd0800655bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:46.495183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 43/83] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/role_assignments?user.id=71fa9aea79124087a13788fd2ea8d178&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.496001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.509111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47ed4a-963d-4772-97a1-b2997c177de7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.516780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 41/84] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:46.519415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.519415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.519781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.520061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.521255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.523325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.525012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 44/85] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.531532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77544791-dc7c-4c63-b075-2dd0800655bb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.544904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77544791-dc7c-4c63-b075-2dd0800655bb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.547850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.562315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceab40-84ec-4ef4-98ae-9328f78de7e7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.563656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.564332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.564615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.564894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.565762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=3b224356d3c840b79f4741c06d6f81d4) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.566077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.568690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.575363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.576208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.576490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.576772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.586273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 42/86] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/role_assignments?user.id=3b224356d3c840b79f4741c06d6f81d4&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.594291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:46.601525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:22:46.602798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 45/87] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:22:46.609071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.625867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b15c98-b181-467a-83e1-b77a90485840 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.630469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.631162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.631487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.631773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.632577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.632888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.634625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.652411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 43/88] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.658164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.668696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad5b58-a754-416e-a598-ca50f03a043d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.676173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faea0d-8eb2-45a5-a232-406c251f2bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.677080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faea0d-8eb2-45a5-a232-406c251f2bed admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.677365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faea0d-8eb2-45a5-a232-406c251f2bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.677644 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faea0d-8eb2-45a5-a232-406c251f2bed admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.685013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faea0d-8eb2-45a5-a232-406c251f2bed admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.687240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faea0d-8eb2-45a5-a232-406c251f2bed admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.689385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 46/89] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.695085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.705265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bce54-52bc-4057-b898-4f20a0bd0aac None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.706178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bce54-52bc-4057-b898-4f20a0bd0aac None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.706472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bce54-52bc-4057-b898-4f20a0bd0aac None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.708796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 47/90] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:46.709479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e076-2e6a-4e58-8237-33205089f1ea admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.714633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5a0b5-a6d6-4ade-9157-060144f757e1 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.715014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5a0b5-a6d6-4ade-9157-060144f757e1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.715251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5a0b5-a6d6-4ade-9157-060144f757e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.721172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.721844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.722130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.722418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.734874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-b5a5a0b5-a6d6-4ade-9157-060144f757e1 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:46.736451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b5a5a0b5-a6d6-4ade-9157-060144f757e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:46.739431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.741239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.746962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 48/91] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:46.758909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 44/92] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:46.765168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5a0b5-a6d6-4ade-9157-060144f757e1 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.775610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5a0b5-a6d6-4ade-9157-060144f757e1 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.780838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.782295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.782801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.783277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] PATH_INFO: `/v3/projects/d3682760d7d74d75ac96a8f73ff977dd` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.787639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3682760d7d74d75ac96a8f73ff977dd)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.787778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.787871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.790483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 49/93] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/projects/d3682760d7d74d75ac96a8f73ff977dd => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:46.797303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f31b40-5309-4a6a-8e87-27e9352ae623 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.799034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.809256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.809628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d092-3266-43e2-ad48-d7faafe79e58 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.810580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.811061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.811661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.813264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.814250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35672b59-54b4-47ef-9dae-5bbd54c5d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.814895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35672b59-54b4-47ef-9dae-5bbd54c5d040 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.815181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35672b59-54b4-47ef-9dae-5bbd54c5d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.815486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35672b59-54b4-47ef-9dae-5bbd54c5d040 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.816235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.816335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35672b59-54b4-47ef-9dae-5bbd54c5d040 admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=d3682760d7d74d75ac96a8f73ff977dd, user.id=71fa9aea79124087a13788fd2ea8d178) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:46.816645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35672b59-54b4-47ef-9dae-5bbd54c5d040 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.818342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 45/94] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:46.821051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35672b59-54b4-47ef-9dae-5bbd54c5d040 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.825080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:46.827494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 50/95] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:46 2022] GET /identity/v3/role_assignments?user.id=71fa9aea79124087a13788fd2ea8d178&scope.project.id=d3682760d7d74d75ac96a8f73ff977dd&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:46.837770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c7675-4b04-439f-9183-0a3af9327622 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:46.842857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f0f6f-5dbd-44cb-9d1f-6e6789297470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:46.843844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0f6f-5dbd-44cb-9d1f-6e6789297470 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:46.844355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0f6f-5dbd-44cb-9d1f-6e6789297470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:46.844831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0f6f-5dbd-44cb-9d1f-6e6789297470 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:46.845768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f0f6f-5dbd-44cb-9d1f-6e6789297470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:46.847022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-dd2f0f6f-5dbd-44cb-9d1f-6e6789297470 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:46.847022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:22:46.847022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:22:46.853828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f0f6f-5dbd-44cb-9d1f-6e6789297470 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:46.890243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 46/96] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:22:46 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:49.174388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fb1d-12a9-4e11-83e7-312bac5f2752 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.175377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fb1d-12a9-4e11-83e7-312bac5f2752 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.175888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fb1d-12a9-4e11-83e7-312bac5f2752 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.178197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 51/97] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:49.183371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dcca2-75a7-4063-91a2-41baae5c154c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.184930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dcca2-75a7-4063-91a2-41baae5c154c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.185435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dcca2-75a7-4063-91a2-41baae5c154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.208672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6b7dcca2-75a7-4063-91a2-41baae5c154c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:49.210263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6b7dcca2-75a7-4063-91a2-41baae5c154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:49.218708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 47/98] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:49.254272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fb1d-12a9-4e11-83e7-312bac5f2752 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.273457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fb1d-12a9-4e11-83e7-312bac5f2752 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.278311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.279358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.279866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.280339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.294233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:49.301710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:22:49.303147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 52/99] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:49.309601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dcca2-75a7-4063-91a2-41baae5c154c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.319018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dcca2-75a7-4063-91a2-41baae5c154c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.326316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.327249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.327765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.328242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.329221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:49.329741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.331605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.343934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 48/100] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.349735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.365769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8406d-021b-4caf-b79c-533a0726cfc2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.370677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.371830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.372313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.372798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.374259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.376641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.382991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 53/101] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.384292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.394666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdb806-2b2f-469d-b058-cce538ddd646 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.402869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90d5b7-acda-436d-9263-2cf0b3377244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.404014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d5b7-acda-436d-9263-2cf0b3377244 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.404500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d5b7-acda-436d-9263-2cf0b3377244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.404976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d5b7-acda-436d-9263-2cf0b3377244 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.406678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90d5b7-acda-436d-9263-2cf0b3377244 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.409000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90d5b7-acda-436d-9263-2cf0b3377244 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.410938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 49/102] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.420219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.430563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560bef-6dab-4494-8c15-0b25fb8710d4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.436363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55f17-359a-419a-8270-7013753357c9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.436962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55f17-359a-419a-8270-7013753357c9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.437450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55f17-359a-419a-8270-7013753357c9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.439982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 50/103] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:49.443638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8609a7-5918-4e68-a97a-57d3252dd5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.444862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8609a7-5918-4e68-a97a-57d3252dd5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.445366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8609a7-5918-4e68-a97a-57d3252dd5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.445841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8609a7-5918-4e68-a97a-57d3252dd5dd admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197/users/71fa9aea79124087a13788fd2ea8d178/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.446183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f3f7-1e14-4924-9e90-515991c9b7fa None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.446477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f3f7-1e14-4924-9e90-515991c9b7fa None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.446762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f3f7-1e14-4924-9e90-515991c9b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.449036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8609a7-5918-4e68-a97a-57d3252dd5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=630217dacb45427f8c81275638cd7197, user_id=71fa9aea79124087a13788fd2ea8d178, role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.452072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8609a7-5918-4e68-a97a-57d3252dd5dd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.473370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 54/104] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:22:49 2022] PUT /identity/v3/projects/630217dacb45427f8c81275638cd7197/users/71fa9aea79124087a13788fd2ea8d178/roles/a72109d329f74a0b9917f5b6b41a425d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:22:49.481194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4195f3f7-1e14-4924-9e90-515991c9b7fa None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:49.482513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4195f3f7-1e14-4924-9e90-515991c9b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:49.515955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd795fa-df24-4aa0-91ae-ba75cb138c56 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.516622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd795fa-df24-4aa0-91ae-ba75cb138c56 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.517121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd795fa-df24-4aa0-91ae-ba75cb138c56 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.519723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 55/105] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:49.525338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317534-9941-4199-912d-3e71d81a6829 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.526147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317534-9941-4199-912d-3e71d81a6829 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.526635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317534-9941-4199-912d-3e71d81a6829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.567383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0c317534-9941-4199-912d-3e71d81a6829 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:49.569082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0c317534-9941-4199-912d-3e71d81a6829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:49.580831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 51/106] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:49.585627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de11b76-c999-41a3-8730-16b4ea4752bd None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.586466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de11b76-c999-41a3-8730-16b4ea4752bd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.587532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de11b76-c999-41a3-8730-16b4ea4752bd None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.590922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 52/107] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:49.591442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 56/108] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:49.596919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ce4b-b44e-4b67-8e9d-134ee9dfb843 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.597572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ce4b-b44e-4b67-8e9d-134ee9dfb843 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.598034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8ce4b-b44e-4b67-8e9d-134ee9dfb843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.611767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de11b76-c999-41a3-8730-16b4ea4752bd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.629485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de11b76-c999-41a3-8730-16b4ea4752bd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.641116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9fe8ce4b-b44e-4b67-8e9d-134ee9dfb843 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:49.641500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.642517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.643939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9fe8ce4b-b44e-4b67-8e9d-134ee9dfb843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:49.644412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.644888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.656793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 57/109] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:49.658311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ce4b-b44e-4b67-8e9d-134ee9dfb843 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.669851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:49.671002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8ce4b-b44e-4b67-8e9d-134ee9dfb843 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.675821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.676607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.676893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.677174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.679206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:22:49.680666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 53/110] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:22:49.686903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.689628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:49.696724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:22:49.698164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 58/111] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:49.699067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.702601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3287-a099-4388-9ad9-e0f865c3a8b7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.709661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3a99-81e8-454c-89eb-9bfa17caccae admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.711846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.712535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.712821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.713106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.713884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:49.714198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.716011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.716613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.717660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.718133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.718600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.726235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 54/112] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.727526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.739656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2870e4a-ea93-4e18-ab9b-912dbb0e3209 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.740931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:49.744576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.745654 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.746722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.747248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.748240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:49.748759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.750052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:22:49.750833 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.751727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 59/113] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:49.752625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.762543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 55/114] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.763770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.774090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b74a21-94b8-4799-ad92-28d2ab6ad897 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.777682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440d125-3622-4a84-8fd1-55180db5a813 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.779315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.780152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.780578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.781015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.782167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:49.782616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.784776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.791695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.793912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.794431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.794843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.797574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.801659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 56/115] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.802653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.803139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.805332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 60/116] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.807853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.820854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410cc91-871f-42fe-9ba5-6bab6e4fd581 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.830187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de5395-26d8-4f64-b5b1-4e8d37f61f4b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.830956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.832039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.832474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.833620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] PATH_INFO: `/v3/users/3b224356d3c840b79f4741c06d6f81d4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.836040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b224356d3c840b79f4741c06d6f81d4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.839252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.842826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.844024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.844529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 57/117] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/users/3b224356d3c840b79f4741c06d6f81d4 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.845189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.845955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.846443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.848535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.854435 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.857627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 61/118] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.858521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.866133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e51d41-54a1-4c8e-8520-f61c552213c4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.877567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eae42e-5cea-4d28-85b6-9dac483196b7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.878784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.879734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.880023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.880303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.881939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.887118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.889178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.890758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.891018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 58/119] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.891807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.892304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.892590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.894376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.899947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.902556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 62/120] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.903646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.914605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bb31f-7fa9-45c2-991e-eacf876fad04 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.915583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00550b7-5958-4a0f-9251-bce81c6cfbe6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:49.920944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.921814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.922154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.922434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197/users/71fa9aea79124087a13788fd2ea8d178/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.924620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630217dacb45427f8c81275638cd7197, user_id=71fa9aea79124087a13788fd2ea8d178, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.927370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.930569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:49.932187 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:49.932430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:49.932711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] PATH_INFO: `/v3/projects/d3682760d7d74d75ac96a8f73ff977dd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:49.940268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3682760d7d74d75ac96a8f73ff977dd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:49.942237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:49.944300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 59/121] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:49 2022] GET /identity/v3/projects/d3682760d7d74d75ac96a8f73ff977dd => generated 312 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:49.945065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.945839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 63/122] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:22:49 2022] PUT /identity/v3/projects/630217dacb45427f8c81275638cd7197/users/71fa9aea79124087a13788fd2ea8d178/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:22:49.956386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:49.956753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef05c63-3f58-411f-a59d-7dbb95c5f6f1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:50.088573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be7a6-f437-45ad-821f-c0df0013516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:50.090479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be7a6-f437-45ad-821f-c0df0013516c admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:50.090981 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be7a6-f437-45ad-821f-c0df0013516c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:50.092662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be7a6-f437-45ad-821f-c0df0013516c admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197/users/3b224356d3c840b79f4741c06d6f81d4/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:50.097796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be7a6-f437-45ad-821f-c0df0013516c admin admin] RBAC: Authorizing `identity:create_grant(project_id=630217dacb45427f8c81275638cd7197, user_id=3b224356d3c840b79f4741c06d6f81d4, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:50.099118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-f14be7a6-f437-45ad-821f-c0df0013516c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:22:50.099118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:22:50.099118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:22:50.100360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f93d51-cb92-486e-90f0-10e113b0dd56 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:50.102606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be7a6-f437-45ad-821f-c0df0013516c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:50.111141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e84db-0f94-4b39-ace3-723cd3e65642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:50.112450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e84db-0f94-4b39-ace3-723cd3e65642 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:50.114727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e84db-0f94-4b39-ace3-723cd3e65642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:50.115229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e84db-0f94-4b39-ace3-723cd3e65642 admin admin] PATH_INFO: `/v3/projects/d3682760d7d74d75ac96a8f73ff977dd/users/71fa9aea79124087a13788fd2ea8d178/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:50.119868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e84db-0f94-4b39-ace3-723cd3e65642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3682760d7d74d75ac96a8f73ff977dd, user_id=71fa9aea79124087a13788fd2ea8d178, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:50.129215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e84db-0f94-4b39-ace3-723cd3e65642 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:50.132950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 60/123] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:22:49 2022] PUT /identity/v3/projects/630217dacb45427f8c81275638cd7197/users/3b224356d3c840b79f4741c06d6f81d4/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:22:50.154310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 64/124] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:22:49 2022] PUT /identity/v3/projects/d3682760d7d74d75ac96a8f73ff977dd/users/71fa9aea79124087a13788fd2ea8d178/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:22:50.927369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeafd7-dc54-4696-893f-2211197c5134 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:50.927877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeafd7-dc54-4696-893f-2211197c5134 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:50.927948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeafd7-dc54-4696-893f-2211197c5134 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:50.929976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 61/125] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:50.935072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188273d-be4a-46fa-9fac-7de66751490c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:50.935505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188273d-be4a-46fa-9fac-7de66751490c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:50.935668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188273d-be4a-46fa-9fac-7de66751490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:50.960369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a188273d-be4a-46fa-9fac-7de66751490c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:50.961563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a188273d-be4a-46fa-9fac-7de66751490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:50.969294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577e0e-b079-44cb-bf3c-0f06dae00b8a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:50.969585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577e0e-b079-44cb-bf3c-0f06dae00b8a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:50.969868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577e0e-b079-44cb-bf3c-0f06dae00b8a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:50.971873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 62/126] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:50.985290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846966a-5b05-4056-aa5d-2bf96442c23e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:50.985586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846966a-5b05-4056-aa5d-2bf96442c23e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:50.985850 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846966a-5b05-4056-aa5d-2bf96442c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.016068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a846966a-5b05-4056-aa5d-2bf96442c23e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:51.017281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a846966a-5b05-4056-aa5d-2bf96442c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:51.085479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 65/127] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:51.109325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 63/128] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:51.133640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188273d-be4a-46fa-9fac-7de66751490c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.148761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188273d-be4a-46fa-9fac-7de66751490c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.150463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846966a-5b05-4056-aa5d-2bf96442c23e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.159822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.160633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.160877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846966a-5b05-4056-aa5d-2bf96442c23e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.160977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.161191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.163950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:51.165709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:51.167317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 66/129] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:51.172867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.173469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.173733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.174199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.174476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.194090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066513-0535-4f50-8ab4-8f242558ddb6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.195250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:51.207437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:22:51.208674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 64/130] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:51.212031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.212697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.212982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.213265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.214007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:51.216530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:51.218626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.241477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af71077-cae0-4aa9-b3c6-c4cbd82129e5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.259639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.260324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.260612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.260891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.262199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:51.262510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:51.265604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:51.284400 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 67/131] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:22:51 2022] POST /identity/v3/projects => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:51.293928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 65/132] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:51.300178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.400606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cbd54-f42e-4112-b1e3-4808072b007b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.410526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.411447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.411740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.412020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] PATH_INFO: `/v3/users/f28bf94b030942a9be37d3b895b2684e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.429037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=f28bf94b030942a9be37d3b895b2684e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:51.431272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:51.433305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 68/133] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:51 2022] GET /identity/v3/users/f28bf94b030942a9be37d3b895b2684e => generated 289 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:51.439085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.453045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaedfee-5490-49b8-b1fb-ca9f0d9a126a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.462198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.462864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.463153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.463454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.475201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:51.477050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:51.489405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 66/134] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:51.495367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.513043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c42962-5749-4e8b-9a21-8fa748e671f2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.523696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d9575-cde6-4996-865f-7393426ceeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.524569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d9575-cde6-4996-865f-7393426ceeda admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.524852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d9575-cde6-4996-865f-7393426ceeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.525130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d9575-cde6-4996-865f-7393426ceeda admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.532134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d9575-cde6-4996-865f-7393426ceeda admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:51.534273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d9575-cde6-4996-865f-7393426ceeda admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:51.536452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 69/135] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:51 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:51.542843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:51.552089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811871-e853-49c1-a362-9217b29a08f7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:51.568790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c054-033e-4c1a-83c4-c8a8489c2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:51.569471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c054-033e-4c1a-83c4-c8a8489c2cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:51.569756 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c054-033e-4c1a-83c4-c8a8489c2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:51.570035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c054-033e-4c1a-83c4-c8a8489c2cb0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:51.570900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c054-033e-4c1a-83c4-c8a8489c2cb0 admin admin] RBAC: Adding query filter params (role.id=f4d66549fc74428f879ff5c3f3f9accc, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=f28bf94b030942a9be37d3b895b2684e) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:51.571212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c054-033e-4c1a-83c4-c8a8489c2cb0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:51.573102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c054-033e-4c1a-83c4-c8a8489c2cb0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:51.580096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 67/136] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:51 2022] GET /identity/v3/role_assignments?user.id=f28bf94b030942a9be37d3b895b2684e&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=f4d66549fc74428f879ff5c3f3f9accc => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:52.781067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395df73-1dfd-4c92-80e8-6fbf2ad7dc4a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:52.782035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395df73-1dfd-4c92-80e8-6fbf2ad7dc4a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:52.782035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395df73-1dfd-4c92-80e8-6fbf2ad7dc4a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:52.783951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 70/137] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:52.797706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207fb2-f995-456b-8692-b4220646e467 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:52.798319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207fb2-f995-456b-8692-b4220646e467 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:52.798319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207fb2-f995-456b-8692-b4220646e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:52.824192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4e207fb2-f995-456b-8692-b4220646e467 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:52.825388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4e207fb2-f995-456b-8692-b4220646e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:52.838773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 68/138] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:52.875291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395df73-1dfd-4c92-80e8-6fbf2ad7dc4a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:52.892035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395df73-1dfd-4c92-80e8-6fbf2ad7dc4a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:52.896507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:52.897309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:52.897592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:52.897870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:52.916624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:52.928399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:22:52.929660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 71/139] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:22:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:52.935413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207fb2-f995-456b-8692-b4220646e467 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:52.945089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207fb2-f995-456b-8692-b4220646e467 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:52.955527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:52.956211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:52.956498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:52.956782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:52.957564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:52.957874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:52.959530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:52.968522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 69/140] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:22:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:52.973922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:52.989192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c18d1-6c70-4b75-ba20-595f5b1a994c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:52.993675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:52.994534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:52.994820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:52.995101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:52.996931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:52.999071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.000926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 72/141] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:52 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.006040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.016121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac5e9-4108-42a8-b517-6a08601400d0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.026352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.026352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.026352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.026352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.037152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.039169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.052320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 70/142] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:53.057402 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.070459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fcd2-8433-4afd-89b2-3a539685c89f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.083251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34194b54-d392-49b4-b2c2-adab7897a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.084135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34194b54-d392-49b4-b2c2-adab7897a9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.084419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34194b54-d392-49b4-b2c2-adab7897a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.084694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34194b54-d392-49b4-b2c2-adab7897a9a8 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.092106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34194b54-d392-49b4-b2c2-adab7897a9a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.094186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34194b54-d392-49b4-b2c2-adab7897a9a8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.095904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 73/143] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.101830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.116935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab8bf7-61ba-4fdc-acdb-6e20cbca3103 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.121815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c38b-23ec-4417-8a43-2633c4f2e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.122777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c38b-23ec-4417-8a43-2633c4f2e8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.123318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c38b-23ec-4417-8a43-2633c4f2e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.123822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c38b-23ec-4417-8a43-2633c4f2e8fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.124862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17c38b-23ec-4417-8a43-2633c4f2e8fa admin admin] RBAC: Adding query filter params (role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=71fa9aea79124087a13788fd2ea8d178) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:53.125418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17c38b-23ec-4417-8a43-2633c4f2e8fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.127531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17c38b-23ec-4417-8a43-2633c4f2e8fa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.140884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 71/144] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/role_assignments?user.id=71fa9aea79124087a13788fd2ea8d178&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.166201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc9b7-3600-4b37-bb3a-f0a549a48477 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.166539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc9b7-3600-4b37-bb3a-f0a549a48477 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.166761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cc9b7-3600-4b37-bb3a-f0a549a48477 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.169353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 74/145] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:53.175807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9bbd-b49c-4b7f-b3e7-84642b591541 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.176443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9bbd-b49c-4b7f-b3e7-84642b591541 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.176919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9bbd-b49c-4b7f-b3e7-84642b591541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.202029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-76bd9bbd-b49c-4b7f-b3e7-84642b591541 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:53.203719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-76bd9bbd-b49c-4b7f-b3e7-84642b591541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:53.218974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 72/146] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:53.259575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cc9b7-3600-4b37-bb3a-f0a549a48477 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.280359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cc9b7-3600-4b37-bb3a-f0a549a48477 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.290797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.291563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.291850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.292127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.311603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:53.318707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:22:53.320330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 75/147] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:53.326548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd9bbd-b49c-4b7f-b3e7-84642b591541 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.339082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd9bbd-b49c-4b7f-b3e7-84642b591541 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.344476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.345447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.345973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.346466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.347519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:53.348105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.355411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.366259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 73/148] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.372921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.390926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a7e9-0dff-425f-bb3b-ae2913922711 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.399879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.400775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.401064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.401349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.408455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.410518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.412549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 76/149] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.418524 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.432207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21821965-6d7a-46b4-af78-76b13554e6d4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.437811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d53fa-16ad-4bfe-a658-8e6cb00878f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.438729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d53fa-16ad-4bfe-a658-8e6cb00878f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.439207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d53fa-16ad-4bfe-a658-8e6cb00878f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.439708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d53fa-16ad-4bfe-a658-8e6cb00878f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.456346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d53fa-16ad-4bfe-a658-8e6cb00878f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.458518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d53fa-16ad-4bfe-a658-8e6cb00878f3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.471936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 74/150] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:53.477749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.491261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0d8e-ae87-48f7-939b-52becee89298 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.491920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0d8e-ae87-48f7-939b-52becee89298 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.492397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0d8e-ae87-48f7-939b-52becee89298 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.494378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 75/151] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:53.497564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b663dc-9ea1-44b1-bad3-8be8177c0867 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.503755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7752-a809-4a0a-b048-1929d239396b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.504393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7752-a809-4a0a-b048-1929d239396b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.504956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7752-a809-4a0a-b048-1929d239396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.506021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.506921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.507168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.507495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] PATH_INFO: `/v3/projects/d3682760d7d74d75ac96a8f73ff977dd` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.508860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] RBAC: Authorizing `identity:get_project(project_id=d3682760d7d74d75ac96a8f73ff977dd)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.511146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.513042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 77/152] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/projects/d3682760d7d74d75ac96a8f73ff977dd => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.520648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.535807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017487f-2a17-491e-a459-1d37b8d25e22 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.536638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-21bf7752-a809-4a0a-b048-1929d239396b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:53.537932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-21bf7752-a809-4a0a-b048-1929d239396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:53.541108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.541948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.542532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.543604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.544792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=d3682760d7d74d75ac96a8f73ff977dd, user.id=71fa9aea79124087a13788fd2ea8d178) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:53.545317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.547643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.560216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 76/153] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:53.561428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 78/154] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/role_assignments?user.id=71fa9aea79124087a13788fd2ea8d178&scope.project.id=d3682760d7d74d75ac96a8f73ff977dd&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.586606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7752-a809-4a0a-b048-1929d239396b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.599960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7752-a809-4a0a-b048-1929d239396b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.607626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2575-0280-45b2-a2ea-e38137b01d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.608558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2575-0280-45b2-a2ea-e38137b01d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.608931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2575-0280-45b2-a2ea-e38137b01d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.609300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2575-0280-45b2-a2ea-e38137b01d44 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.624381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f2575-0280-45b2-a2ea-e38137b01d44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:53.632892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4e9f2575-0280-45b2-a2ea-e38137b01d44 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:22:53.634170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 77/155] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:53.640078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.653194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3694-d5da-45f2-a92f-d227af7a36c9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.653636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3694-d5da-45f2-a92f-d227af7a36c9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.654002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3694-d5da-45f2-a92f-d227af7a36c9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.656663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 78/156] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:53.658024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378297b6-c7c1-457c-aa44-47b43c99674c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.662792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1c4a-1dfe-4bad-848c-75daedf554b2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.663085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1c4a-1dfe-4bad-848c-75daedf554b2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.663364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c1c4a-1dfe-4bad-848c-75daedf554b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.667545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.669246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.669771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.670244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.671379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:53.671921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.673898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.686841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e38c1c4a-1dfe-4bad-848c-75daedf554b2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:53.688089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e38c1c4a-1dfe-4bad-848c-75daedf554b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:53.693250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 79/157] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.701229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.701393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 79/158] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:53.716846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96e971-f376-4995-9167-a9ec943fb7e0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.726529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.726780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c1c4a-1dfe-4bad-848c-75daedf554b2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.727976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.728458 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.728929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] PATH_INFO: `/v3/users/71fa9aea79124087a13788fd2ea8d178` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.736330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] RBAC: Authorizing `identity:get_user(user_id=71fa9aea79124087a13788fd2ea8d178)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.738952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.739132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c1c4a-1dfe-4bad-848c-75daedf554b2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.741193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 80/159] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/users/71fa9aea79124087a13788fd2ea8d178 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:53.748084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.748957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.749237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.749560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.754843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.765797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:53.772126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c0307-6eb5-44e5-bd12-91dad7a846fc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.780576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:22:53.782670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.784188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 80/160] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:22:53.784380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.789524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.789827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.792243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.805413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42674c-4d62-412f-b378-c3fe3929c3c4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.807776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.810119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.812417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.813154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.813431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.813766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.814535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:53.814917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.816718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.827007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 81/161] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:53.829453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 81/162] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.832897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.837855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.849666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a9e26-4944-4ec0-9197-f05dd34c2d78 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.852670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8680-7131-4f2e-883a-27990dbfaab3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.862208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.863065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.863347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.863649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.865210 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.868799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.871204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.871713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.871993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.872265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] PATH_INFO: `/v3/users/3b224356d3c840b79f4741c06d6f81d4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.872828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 82/163] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.873731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=3b224356d3c840b79f4741c06d6f81d4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.875308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.877121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 82/164] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/users/3b224356d3c840b79f4741c06d6f81d4 => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.880020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.884367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.889778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f3b8a-cbe0-43e8-882d-eca7a2a44bdf admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.895202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.895924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.896209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.896540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.897442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=71fa9aea79124087a13788fd2ea8d178) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:53.897684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c825-3942-43dd-92c1-897c8df8a0d2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.897843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.899862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.903962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.905131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.905607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.906075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.907265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 83/165] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/role_assignments?user.id=71fa9aea79124087a13788fd2ea8d178&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.916353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.919065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.929955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 83/166] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:53.938730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.950085 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e1590-7fc2-41e0-bd80-50b232d2439c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.958192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517840-d83b-47d3-bb41-bfeb29dca2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.959122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517840-d83b-47d3-bb41-bfeb29dca2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.959571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517840-d83b-47d3-bb41-bfeb29dca2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.959916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517840-d83b-47d3-bb41-bfeb29dca2a7 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.961191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517840-d83b-47d3-bb41-bfeb29dca2a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.963373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517840-d83b-47d3-bb41-bfeb29dca2a7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.965950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 84/167] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:53.971858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:53.982222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a89fe-8e1e-4d24-87c8-4cc6e8c5c5e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:53.987002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e1c31-eb7b-4591-a95f-293313bf2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:53.987746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1c31-eb7b-4591-a95f-293313bf2064 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:53.988084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1c31-eb7b-4591-a95f-293313bf2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:53.988368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e1c31-eb7b-4591-a95f-293313bf2064 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:53.989293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e1c31-eb7b-4591-a95f-293313bf2064 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=3b224356d3c840b79f4741c06d6f81d4) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:53.989606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e1c31-eb7b-4591-a95f-293313bf2064 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:53.991669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e1c31-eb7b-4591-a95f-293313bf2064 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:53.998690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 84/168] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:53 2022] GET /identity/v3/role_assignments?user.id=3b224356d3c840b79f4741c06d6f81d4&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:54.821891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c41a8-9136-4988-b9ab-fc0f37708957 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.822406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c41a8-9136-4988-b9ab-fc0f37708957 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.822493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c41a8-9136-4988-b9ab-fc0f37708957 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.824846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 85/169] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:54.826370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7b9d2-7e6c-47aa-acc7-045ba9c7928b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.826761 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7b9d2-7e6c-47aa-acc7-045ba9c7928b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.826941 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7b9d2-7e6c-47aa-acc7-045ba9c7928b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.828857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 85/170] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:54.829680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab411c-6935-4441-9889-8420057ace30 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.829971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab411c-6935-4441-9889-8420057ace30 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.830250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab411c-6935-4441-9889-8420057ace30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.833642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339bcdb-de45-47cf-894c-993a29cc16c3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.833908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339bcdb-de45-47cf-894c-993a29cc16c3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.834186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339bcdb-de45-47cf-894c-993a29cc16c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.847801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-90ab411c-6935-4441-9889-8420057ace30 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:54.849003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-90ab411c-6935-4441-9889-8420057ace30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:54.851215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2339bcdb-de45-47cf-894c-993a29cc16c3 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:54.852394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2339bcdb-de45-47cf-894c-993a29cc16c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:54.856691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 86/171] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:54.860478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 86/172] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:54.881472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab411c-6935-4441-9889-8420057ace30 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:54.882686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339bcdb-de45-47cf-894c-993a29cc16c3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:54.890982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab411c-6935-4441-9889-8420057ace30 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:54.892201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339bcdb-de45-47cf-894c-993a29cc16c3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:54.895206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:54.896043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.896327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.896562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:54.896664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.897429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.897712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.897798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:54.897987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.899433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:54.900974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 87/173] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:54.906021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:54.908246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:54.914958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:22:54.915171 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ad466-ef45-4ef7-998d-c788ca1e4550 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:54.916274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 87/174] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:22:54.919374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:54.920006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.920302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.920791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.921318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:54.921501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:54.923344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:54.930290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8220c-16d9-4182-8102-5ac8dcc5c145 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:54.935209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:54.935888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.936173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.936452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.937225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:54.937526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:54.939127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:54.943255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 88/175] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:22:54 2022] POST /identity/v3/users => generated 283 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:22:54.948013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 88/176] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:54.954325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:54.964552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019193-f99d-4d9c-b02b-6fdeaea5bff3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:54.969811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:54.970699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.970980 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.971254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] PATH_INFO: `/v3/users/f28bf94b030942a9be37d3b895b2684e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:54.972585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] RBAC: Authorizing `identity:get_user(user_id=f28bf94b030942a9be37d3b895b2684e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:54.974756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:54.976459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 89/177] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:54 2022] GET /identity/v3/users/f28bf94b030942a9be37d3b895b2684e => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:54.982868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:54.992915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a4182-34b5-4c51-99ef-294667a3db0d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:54.998024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f03ba-9c0c-40b2-b64d-4337149ede9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:54.998915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f03ba-9c0c-40b2-b64d-4337149ede9f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:54.999196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f03ba-9c0c-40b2-b64d-4337149ede9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:54.999502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f03ba-9c0c-40b2-b64d-4337149ede9f admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:55.000792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f03ba-9c0c-40b2-b64d-4337149ede9f admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:55.002912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f03ba-9c0c-40b2-b64d-4337149ede9f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:55.004746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 89/178] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:54 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:55.010514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:55.020546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a028a3e-588b-4e94-952c-7420043dd37e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:55.024956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5041f60-d21a-4e63-bc15-5dad937006ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:55.025861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041f60-d21a-4e63-bc15-5dad937006ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:55.026147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041f60-d21a-4e63-bc15-5dad937006ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:55.026429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5041f60-d21a-4e63-bc15-5dad937006ba admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197/users/f28bf94b030942a9be37d3b895b2684e/roles/f4d66549fc74428f879ff5c3f3f9accc` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:55.028493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5041f60-d21a-4e63-bc15-5dad937006ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=630217dacb45427f8c81275638cd7197, user_id=f28bf94b030942a9be37d3b895b2684e, role_id=f4d66549fc74428f879ff5c3f3f9accc)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:55.031498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5041f60-d21a-4e63-bc15-5dad937006ba admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:55.045521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 90/179] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:22:55 2022] PUT /identity/v3/projects/630217dacb45427f8c81275638cd7197/users/f28bf94b030942a9be37d3b895b2684e/roles/f4d66549fc74428f879ff5c3f3f9accc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:22:57.267842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40696a-8683-4b24-8fdc-f407c3508f1e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.268867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40696a-8683-4b24-8fdc-f407c3508f1e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.269359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40696a-8683-4b24-8fdc-f407c3508f1e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.271331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 90/180] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:57.276857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251642d-6850-4bee-b62f-870f9ac20163 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.278277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251642d-6850-4bee-b62f-870f9ac20163 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.278769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251642d-6850-4bee-b62f-870f9ac20163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.296809 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c251642d-6850-4bee-b62f-870f9ac20163 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:57.298271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c251642d-6850-4bee-b62f-870f9ac20163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:57.313976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491025e0-f7a6-4223-9142-47db35afbc55 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.314275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491025e0-f7a6-4223-9142-47db35afbc55 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.314563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491025e0-f7a6-4223-9142-47db35afbc55 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.316486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 91/181] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:22:57.324847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407af51-db13-4c1b-96ee-9804fc3dc09b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.325250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407af51-db13-4c1b-96ee-9804fc3dc09b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.325629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407af51-db13-4c1b-96ee-9804fc3dc09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.343805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7407af51-db13-4c1b-96ee-9804fc3dc09b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:57.345130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7407af51-db13-4c1b-96ee-9804fc3dc09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:57.367098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 91/182] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:57.390786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251642d-6850-4bee-b62f-870f9ac20163 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.403099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251642d-6850-4bee-b62f-870f9ac20163 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.407852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61711e-e090-4041-9a10-f9c2ae853be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.408640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61711e-e090-4041-9a10-f9c2ae853be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.408927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61711e-e090-4041-9a10-f9c2ae853be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.409203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61711e-e090-4041-9a10-f9c2ae853be2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.411375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 92/183] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:57.412925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974973-e444-4dca-b756-a5ee227e37ed None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.413215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974973-e444-4dca-b756-a5ee227e37ed None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.413493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41974973-e444-4dca-b756-a5ee227e37ed None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.415289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 93/184] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:57.416299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def988ff-2e11-4824-a4fb-012be83c1ed1 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.416588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def988ff-2e11-4824-a4fb-012be83c1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.416863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def988ff-2e11-4824-a4fb-012be83c1ed1 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.418594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 94/185] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:22:57.421093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61711e-e090-4041-9a10-f9c2ae853be2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:57.423408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62e09-4198-4a89-b42d-10f7e968b899 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.423698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62e09-4198-4a89-b42d-10f7e968b899 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.423975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62e09-4198-4a89-b42d-10f7e968b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.428648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-bb61711e-e090-4041-9a10-f9c2ae853be2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:22:57.430165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 92/186] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:57.431375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0abfd-d1c4-49a1-9de5-90c975c1dae2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.431686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0abfd-d1c4-49a1-9de5-90c975c1dae2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.432833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0abfd-d1c4-49a1-9de5-90c975c1dae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.443072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b5a62e09-4198-4a89-b42d-10f7e968b899 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:57.444265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b5a62e09-4198-4a89-b42d-10f7e968b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:57.450685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-22c0abfd-d1c4-49a1-9de5-90c975c1dae2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:22:57.451868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-22c0abfd-d1c4-49a1-9de5-90c975c1dae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:22:57.452421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 95/187] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:22:57.453031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a62e09-4198-4a89-b42d-10f7e968b899 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.459987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 93/188] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:22:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:22:57.460611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0abfd-d1c4-49a1-9de5-90c975c1dae2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.467145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a62e09-4198-4a89-b42d-10f7e968b899 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.470351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0abfd-d1c4-49a1-9de5-90c975c1dae2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.472686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.473962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.474527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.474723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.475308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.475426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.475653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.475929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.476683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:57.476990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.478602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.487289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 94/189] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.488134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.492017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:57.497612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5df33-3d9b-4ca3-9350-b978aaf842f2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.498918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:22:57.503734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 96/190] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:57.503734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.505655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.506416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.506700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.506976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.513219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8ddab-8178-4907-8cb5-18cc94cdd357 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.518243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:22:57.518424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.519084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.519486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.519851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.521192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.523014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.524594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 97/191] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.524594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.529672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:22:57.529672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 95/192] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:22:57.529672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.539065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52476e-854c-470e-b7b3-568bbf76104b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.539180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c1995-76eb-4f7c-a7da-b2dc00ab47e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.543312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.543464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.543946 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.544194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.544277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.544478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.544575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.544756 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] PATH_INFO: `/v3/users/f28bf94b030942a9be37d3b895b2684e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.545229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:57.545539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.545965 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] RBAC: Authorizing `identity:get_user(user_id=f28bf94b030942a9be37d3b895b2684e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.547123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.548084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.549626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 98/193] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/users/f28bf94b030942a9be37d3b895b2684e => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.550341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.555905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 96/194] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.560422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.560533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d108680-8f46-4b7f-9b72-e1b62e114d1c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.564254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.564888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.565173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.565449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.565620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19760-21ef-4b70-9f09-4d08252a2e95 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.566163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.568101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.569934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.570548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.570831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.571110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.571885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:57.572197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.573751 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.584045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 97/195] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.584680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.587911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 99/196] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:22:57 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:22:57.588835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.599581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f467e-189b-4fb1-98da-7f1f9b5e57af admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.600637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c63d31-29f8-4cde-8ea1-64574edda718 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.605324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.606025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.606281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.606556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.607199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.608126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.608411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.608689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] PATH_INFO: `/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.615078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.616936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.626028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f3e5c47d3d498f8772d7a0e1ee3437)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.627344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 98/197] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:57.628285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.630047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 100/198] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437 => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.632123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.634977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.644950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048e892-d888-4c40-a74a-392784e98f14 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.650206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.651112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.651472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.651912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] PATH_INFO: `/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.652818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c86a7-bc50-4a28-9f27-1dc6841b37d7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.653280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] RBAC: Authorizing `identity:get_user(user_id=32f3e5c47d3d498f8772d7a0e1ee3437)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.655668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.657856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 99/199] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.658433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.659355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.659673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.659951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.661239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.663104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.663713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.670442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 101/200] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.670442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.673503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ccc64-5da0-4e6e-9304-05a29307deee admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.678370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.679045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.679334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.679645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.681888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2001-9e5f-4a07-8245-cd81f4fc9044 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.687084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.687966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.688417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.688834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.688945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.690613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.697802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.700289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.705639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 100/201] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:57.705639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.711468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160fa3b-c535-46cf-bab6-2f719e2baf38 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.716628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 102/202] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:22:57.716628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.721676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.722401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.722613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49081-287c-4ca5-bd8e-12214dcd5cea admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.722729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.722953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.723841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] RBAC: Adding query filter params (role.id=f4d66549fc74428f879ff5c3f3f9accc, scope.project.id=630217dacb45427f8c81275638cd7197, user.id=f28bf94b030942a9be37d3b895b2684e) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:57.724152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.726058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.727049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.728079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.728264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.728513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.730248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.732370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.743964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 101/203] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/role_assignments?user.id=f28bf94b030942a9be37d3b895b2684e&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=f4d66549fc74428f879ff5c3f3f9accc => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.743964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.744220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 103/204] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.750284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.755181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581551c-0a79-4663-a507-933fb43a6722 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.760912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.764828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.764828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.764828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.765113 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc16564-0701-487f-aef0-20cfe7250d2c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.765188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.766350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.769197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eac3d2-f948-46e6-8052-b8c4ca6fd990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.769348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 102/205] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:22:57.769438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac3d2-f948-46e6-8052-b8c4ca6fd990 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.769438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac3d2-f948-46e6-8052-b8c4ca6fd990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.769438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac3d2-f948-46e6-8052-b8c4ca6fd990 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.770663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eac3d2-f948-46e6-8052-b8c4ca6fd990 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=32f3e5c47d3d498f8772d7a0e1ee3437) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:57.770985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eac3d2-f948-46e6-8052-b8c4ca6fd990 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.772904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eac3d2-f948-46e6-8052-b8c4ca6fd990 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.775725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:22:57.783160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 104/206] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/role_assignments?user.id=32f3e5c47d3d498f8772d7a0e1ee3437&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:22:57.788601 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac76ed0-7172-4568-a508-4f23e4eae83d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:22:57.796025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4476d8-9314-4eb8-800e-25cadb6349dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:22:57.796998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4476d8-9314-4eb8-800e-25cadb6349dd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:22:57.797427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4476d8-9314-4eb8-800e-25cadb6349dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:22:57.797844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4476d8-9314-4eb8-800e-25cadb6349dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:22:57.798975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4476d8-9314-4eb8-800e-25cadb6349dd admin admin] RBAC: Adding query filter params (role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=32f3e5c47d3d498f8772d7a0e1ee3437) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:22:57.799513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4476d8-9314-4eb8-800e-25cadb6349dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:22:57.801786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4476d8-9314-4eb8-800e-25cadb6349dd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:22:57.810841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 103/207] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:22:57 2022] GET /identity/v3/role_assignments?user.id=32f3e5c47d3d498f8772d7a0e1ee3437&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.018112 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d993af-8e6b-4cda-902b-41c846e93458 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.018613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d993af-8e6b-4cda-902b-41c846e93458 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.018707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d993af-8e6b-4cda-902b-41c846e93458 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.020727 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 105/208] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:00.026162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03102be-0d41-4670-9029-5a3af40729b6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.026583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03102be-0d41-4670-9029-5a3af40729b6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.026749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03102be-0d41-4670-9029-5a3af40729b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.038451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7948f4-296c-4945-9721-38771e565b5b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.038742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7948f4-296c-4945-9721-38771e565b5b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.039018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7948f4-296c-4945-9721-38771e565b5b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.041058 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 106/209] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:00.048225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63435cc-29f9-476c-8e0e-5e73324c2798 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.048418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a03102be-0d41-4670-9029-5a3af40729b6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:00.048722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63435cc-29f9-476c-8e0e-5e73324c2798 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.049101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63435cc-29f9-476c-8e0e-5e73324c2798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.050017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a03102be-0d41-4670-9029-5a3af40729b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:00.065157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 104/210] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:00.071900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f63435cc-29f9-476c-8e0e-5e73324c2798 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:00.072764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf4fa-5b27-480f-a60c-7de080ea656a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.073054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf4fa-5b27-480f-a60c-7de080ea656a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.073333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f63435cc-29f9-476c-8e0e-5e73324c2798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:00.073511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf4fa-5b27-480f-a60c-7de080ea656a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.075764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 105/211] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:00.080624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0eb28-e1d4-4d00-94b0-cb83b7fbb8c9 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.080911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0eb28-e1d4-4d00-94b0-cb83b7fbb8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.081186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0eb28-e1d4-4d00-94b0-cb83b7fbb8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.082724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 107/212] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:00.087153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02630-4cfd-4aef-912d-b54f28ce8144 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.087841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02630-4cfd-4aef-912d-b54f28ce8144 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.088262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02630-4cfd-4aef-912d-b54f28ce8144 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.091165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 108/213] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:00.093100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce02630-4cfd-4aef-912d-b54f28ce8144 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.100018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1da0eb28-e1d4-4d00-94b0-cb83b7fbb8c9 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:00.101205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1da0eb28-e1d4-4d00-94b0-cb83b7fbb8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:00.107243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce02630-4cfd-4aef-912d-b54f28ce8144 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.108672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 106/214] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:00.109880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12e858-79b2-4616-b672-896ca3e2c965 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.110165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12e858-79b2-4616-b672-896ca3e2c965 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.110480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12e858-79b2-4616-b672-896ca3e2c965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.111795 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.112560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.112842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.113116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.124142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:00.128204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7a12e858-79b2-4616-b672-896ca3e2c965 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:00.129352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7a12e858-79b2-4616-b672-896ca3e2c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:00.130900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:00.132123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 109/215] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:00.132882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.137461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 107/216] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:00.140286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12e858-79b2-4616-b672-896ca3e2c965 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.142685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328493c2-7aac-4da6-a801-198f259b9426 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.147332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.148082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.148366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.148643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.149087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12e858-79b2-4616-b672-896ca3e2c965 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.149928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.151785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.153446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.153823 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 110/217] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.154571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.158753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.159198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.159501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.165082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b117d8-7d8d-4429-a5cb-9b4a3fbda8ea admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.169372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.169587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:00.169984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.170270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.170545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.171292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:00.171623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.173180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.176767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:00.178228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 108/218] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:00.178657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.181471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 111/219] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.182181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.189779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4655b3-66f6-4f3b-b8ca-6adf7ce738bb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.192257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405fcf8-dd3a-48a4-a53c-288e4d4318ef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.193932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.194557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.194836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.195110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.195850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.196446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.197175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.197457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.197727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.197821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.208390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:00.215383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:00.217087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 112/220] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:00.217855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.229890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 109/221] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:00 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:00.229890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.230674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf53e-48a6-465b-9df2-c2fa73c37b81 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.234955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.235711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.236004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.236286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.236441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b1b01-d99c-4f8a-83ff-b5f662c843a9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.237176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:00.237407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.239067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.241353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.242251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.242533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.242811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] PATH_INFO: `/v3/users/a8ffc830ec284bdc89f3564e3ca45a28` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.256165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 113/222] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.256165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.258756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] RBAC: Authorizing `identity:get_user(user_id=a8ffc830ec284bdc89f3564e3ca45a28)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.261088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.262969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 110/223] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/users/a8ffc830ec284bdc89f3564e3ca45a28 => generated 297 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.263695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.267184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edc941-09cc-4b78-88fc-d75df0b51594 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.271809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.272499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.272845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.273129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.273920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:00.274231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.275922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.277009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c791f-7109-46b4-8b9b-05227ce1c7cb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.282182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.283063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.283255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.283587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] PATH_INFO: `/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.285013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f3e5c47d3d498f8772d7a0e1ee3437)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.291221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 114/224] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.291382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.291488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.291556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 111/225] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.291881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.302921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcd117-bb07-4890-9a18-0910e5abe973 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.305601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c5ae8-607b-4371-a8ad-4cdfd332b804 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.307334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.308923 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.309214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.309498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] PATH_INFO: `/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.310752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f3e5c47d3d498f8772d7a0e1ee3437)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.311181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.311969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.312338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.312676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.312945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.319499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 112/226] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:00.319499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.321681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.323505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.329033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acf165-ad23-4c82-92ae-69c00b961e10 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.333118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 115/227] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:00.333746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.338389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.339276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.339623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.339905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.341197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.343283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.343777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd328e43-2ccb-442b-8288-606f9d73dfcf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.345201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 113/228] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.345831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.352712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.353889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.354177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.354457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.356152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498608c2-bdc3-48b4-833d-81d6a08059a1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.356398 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.358632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.360559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 116/229] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.360668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.361510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.361795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.362075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.363285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.365446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.366125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.367314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 114/230] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:00.373487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.377889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0416-e7c9-40de-8ffa-4e34e39e8b40 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.383178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4aa16-25e9-4e06-92c4-00e977489e74 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.383364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.384371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.384661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.384947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c/users/32f3e5c47d3d498f8772d7a0e1ee3437/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.387215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=272bf5eaae46468b983a59aae152c09c, user_id=32f3e5c47d3d498f8772d7a0e1ee3437, role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.387595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c70e-c60b-4925-a09a-710fb51d32e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.388471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c70e-c60b-4925-a09a-710fb51d32e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.388749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c70e-c60b-4925-a09a-710fb51d32e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.389024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c70e-c60b-4925-a09a-710fb51d32e7 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c/users/32f3e5c47d3d498f8772d7a0e1ee3437/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.389934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.390985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c70e-c60b-4925-a09a-710fb51d32e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272bf5eaae46468b983a59aae152c09c, user_id=32f3e5c47d3d498f8772d7a0e1ee3437, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.393639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c70e-c60b-4925-a09a-710fb51d32e7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.405341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 117/231] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:00 2022] PUT /identity/v3/projects/272bf5eaae46468b983a59aae152c09c/users/32f3e5c47d3d498f8772d7a0e1ee3437/roles/a72109d329f74a0b9917f5b6b41a425d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:00.405960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:00.414268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 115/232] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:00 2022] PUT /identity/v3/projects/272bf5eaae46468b983a59aae152c09c/users/32f3e5c47d3d498f8772d7a0e1ee3437/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:00.481682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c32e-9746-4ad0-9948-94c6aa4d42fe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:00.553811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11727-6460-4099-836a-2d17c081c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:00.554491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11727-6460-4099-836a-2d17c081c1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:00.554780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11727-6460-4099-836a-2d17c081c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:00.555065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11727-6460-4099-836a-2d17c081c1b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:00.555986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11727-6460-4099-836a-2d17c081c1b9 admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=a8ffc830ec284bdc89f3564e3ca45a28) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:00.556306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11727-6460-4099-836a-2d17c081c1b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:00.559041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11727-6460-4099-836a-2d17c081c1b9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:00.565772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 118/233] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:00 2022] GET /identity/v3/role_assignments?user.id=a8ffc830ec284bdc89f3564e3ca45a28&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:02.911977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007c76-e1c7-4fd0-8629-a61f81dc9306 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:02.912485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007c76-e1c7-4fd0-8629-a61f81dc9306 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:02.912558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007c76-e1c7-4fd0-8629-a61f81dc9306 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:02.914662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 116/234] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:02.920583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313238bb-3d00-4fce-90b8-4e9912635747 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:02.921090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313238bb-3d00-4fce-90b8-4e9912635747 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:02.921161 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313238bb-3d00-4fce-90b8-4e9912635747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:02.948577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-313238bb-3d00-4fce-90b8-4e9912635747 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:02.950361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-313238bb-3d00-4fce-90b8-4e9912635747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:02.958176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 119/235] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:02.990624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02007c76-e1c7-4fd0-8629-a61f81dc9306 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.009844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02007c76-e1c7-4fd0-8629-a61f81dc9306 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.015027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.015877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.016163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.016442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.034811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:03.041833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:03.043909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 117/236] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:03.049810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313238bb-3d00-4fce-90b8-4e9912635747 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.059518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313238bb-3d00-4fce-90b8-4e9912635747 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.070799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.071512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.071797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.072074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.072862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:03.073171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.074858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.084046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 120/237] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.090525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.105593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867d41-8de0-4fd6-80f1-a832a0c418b9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.113128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.114024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.114310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.114587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] PATH_INFO: `/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.115909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f3e5c47d3d498f8772d7a0e1ee3437)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.118091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.119974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 118/238] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.125664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.135511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ad0c-da78-4bf3-b678-ad2256152626 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.146299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.146942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.147224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.147533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.156665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.158409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.167523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 121/239] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:03.173652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.188306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104c675-2d77-41a5-91aa-b49b47cd79e4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.192764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cdffc-ab82-4eac-8207-3274773fff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.193609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cdffc-ab82-4eac-8207-3274773fff91 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.193890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cdffc-ab82-4eac-8207-3274773fff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.194165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cdffc-ab82-4eac-8207-3274773fff91 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.195359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cdffc-ab82-4eac-8207-3274773fff91 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.197431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cdffc-ab82-4eac-8207-3274773fff91 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.203768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 119/240] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.210384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.220259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae65e92-9f16-46e9-a8c5-cdb21c6edcaf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.222429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb859a-fe64-476d-bde9-02fab3c6e2e6 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.222723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb859a-fe64-476d-bde9-02fab3c6e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.222999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb859a-fe64-476d-bde9-02fab3c6e2e6 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.224969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 120/241] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:03.232166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72fa09-1436-438e-85af-cf59c9e5100d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.232395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.232603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72fa09-1436-438e-85af-cf59c9e5100d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.232749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72fa09-1436-438e-85af-cf59c9e5100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.232887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.233128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.233412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.234371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=32f3e5c47d3d498f8772d7a0e1ee3437) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:03.234685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.236559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.243572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 122/242] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/role_assignments?user.id=32f3e5c47d3d498f8772d7a0e1ee3437&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.257084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-8c72fa09-1436-438e-85af-cf59c9e5100d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:03.258286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8c72fa09-1436-438e-85af-cf59c9e5100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:03.273514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 121/243] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:03.317071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.332918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798a985-c809-4224-ab4e-c37f325b962d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.343925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec4461-fdc5-430c-a2d4-6f4eb46006a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.344743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4461-fdc5-430c-a2d4-6f4eb46006a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.345023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4461-fdc5-430c-a2d4-6f4eb46006a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.345301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4461-fdc5-430c-a2d4-6f4eb46006a3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.364422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec4461-fdc5-430c-a2d4-6f4eb46006a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:03.371445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-83ec4461-fdc5-430c-a2d4-6f4eb46006a3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:23:03.372908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 123/244] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:03.378727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72fa09-1436-438e-85af-cf59c9e5100d None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.383956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec61bcc-6a3e-418c-955b-2d348dc264d3 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.383956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec61bcc-6a3e-418c-955b-2d348dc264d3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.383956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec61bcc-6a3e-418c-955b-2d348dc264d3 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.385627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 124/245] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:03.388561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a1ac-3805-4575-ba61-5709d8d7f92d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.388561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a1ac-3805-4575-ba61-5709d8d7f92d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.388561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a1ac-3805-4575-ba61-5709d8d7f92d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.389242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 125/246] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:03.390181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d43e-bd3e-4e06-807d-5118d2b0ac59 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.390467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d43e-bd3e-4e06-807d-5118d2b0ac59 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.390744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d43e-bd3e-4e06-807d-5118d2b0ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.396323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72fa09-1436-438e-85af-cf59c9e5100d None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.404135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f4df-95e1-4321-8887-5bc4ee2ed4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.405194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f4df-95e1-4321-8887-5bc4ee2ed4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.405723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f4df-95e1-4321-8887-5bc4ee2ed4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.406447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f4df-95e1-4321-8887-5bc4ee2ed4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.407483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f4df-95e1-4321-8887-5bc4ee2ed4b0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:03.407997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f4df-95e1-4321-8887-5bc4ee2ed4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.410086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f4df-95e1-4321-8887-5bc4ee2ed4b0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.410695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a777d43e-bd3e-4e06-807d-5118d2b0ac59 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:03.411946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a777d43e-bd3e-4e06-807d-5118d2b0ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:03.420814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 122/247] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.421982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 126/248] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:03.422771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a6e44-d58a-4c43-a4af-dbb4311e8b1b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.423144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a6e44-d58a-4c43-a4af-dbb4311e8b1b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.427445 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a6e44-d58a-4c43-a4af-dbb4311e8b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.427616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d43e-bd3e-4e06-807d-5118d2b0ac59 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.444237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-665a6e44-d58a-4c43-a4af-dbb4311e8b1b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:03.445561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-665a6e44-d58a-4c43-a4af-dbb4311e8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:03.446917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d43e-bd3e-4e06-807d-5118d2b0ac59 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.458551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a767b-0e2d-413f-9325-8d08f2d85930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.459326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 123/249] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:03.459487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a767b-0e2d-413f-9325-8d08f2d85930 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.459757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a767b-0e2d-413f-9325-8d08f2d85930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.460028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a767b-0e2d-413f-9325-8d08f2d85930 admin admin] PATH_INFO: `/v3/users/62aeda6b49954a9ea353846cffdf09b6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.462446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a6e44-d58a-4c43-a4af-dbb4311e8b1b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.478119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a6e44-d58a-4c43-a4af-dbb4311e8b1b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.482305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a767b-0e2d-413f-9325-8d08f2d85930 admin admin] RBAC: Authorizing `identity:get_user(user_id=62aeda6b49954a9ea353846cffdf09b6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.483166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.483995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.484275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.484549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.484764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a767b-0e2d-413f-9325-8d08f2d85930 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.487573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 127/250] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/users/62aeda6b49954a9ea353846cffdf09b6 => generated 297 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.488875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1ca17-21fb-49b7-8325-df5512dffd09 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.489168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1ca17-21fb-49b7-8325-df5512dffd09 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.489450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1ca17-21fb-49b7-8325-df5512dffd09 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.492537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 128/251] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:03.493433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1ca17-21fb-49b7-8325-df5512dffd09 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.496901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:03.504389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:03.505815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 124/252] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:03.506574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.513914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1ca17-21fb-49b7-8325-df5512dffd09 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.516629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c27c-301f-4943-8f47-7cb34968097c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.518324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c217c18-4c0d-4d0e-aec5-2c309ea99349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.519105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c217c18-4c0d-4d0e-aec5-2c309ea99349 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.519383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c217c18-4c0d-4d0e-aec5-2c309ea99349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.519689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c217c18-4c0d-4d0e-aec5-2c309ea99349 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.520837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c217c18-4c0d-4d0e-aec5-2c309ea99349 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.521239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.521850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.522129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.522404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.522495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c217c18-4c0d-4d0e-aec5-2c309ea99349 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.524251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 129/253] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.525299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb590c0-5d26-4495-86de-aac911ec5e97 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.525581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb590c0-5d26-4495-86de-aac911ec5e97 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.525858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb590c0-5d26-4495-86de-aac911ec5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.536275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.538037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.544431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8cb590c0-5d26-4495-86de-aac911ec5e97 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:03.545590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8cb590c0-5d26-4495-86de-aac911ec5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:03.546836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 125/254] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:03.547628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.553872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 130/255] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:03.555060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb590c0-5d26-4495-86de-aac911ec5e97 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.558120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0f736-0b8a-4baf-93bf-e80476adeb42 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.563533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb590c0-5d26-4495-86de-aac911ec5e97 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.565681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.566322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.566601 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.566877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.567655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:03.567959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.569741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.569849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.570392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.570673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.570950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.571713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.573604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.584317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 126/256] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.584317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.591347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604365a2-136b-4990-8c87-565520ba9dbf admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.595866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.596696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.596972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.597244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.598404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.598713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 131/257] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:03 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:03.599557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.601522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.604576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 127/258] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.604576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.613406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a4c87-5cf3-409c-ac17-a4c768c51c8d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.617643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd70943-10e8-4857-83a3-5818b9d7bcc5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.618532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.619489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.619786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.620048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] PATH_INFO: `/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.621883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f3e5c47d3d498f8772d7a0e1ee3437)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.622878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.623724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.624007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.624158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.624265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.630689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 132/259] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/users/32f3e5c47d3d498f8772d7a0e1ee3437 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.630689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.636970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d19d5-ab90-4c69-8cfd-c0a51b95a345 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.641986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.642758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.643054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.643352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.644262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] RBAC: Adding query filter params (role.id=f4d66549fc74428f879ff5c3f3f9accc, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=62aeda6b49954a9ea353846cffdf09b6) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:03.644654 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.645024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:03.646811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.654065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 133/260] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/role_assignments?user.id=62aeda6b49954a9ea353846cffdf09b6&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=f4d66549fc74428f879ff5c3f3f9accc => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.654823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:03.656540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 128/261] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:03.656934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.665539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.675901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da3d17-23c3-45f9-ad59-275e60ef850b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.677184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb874595-662e-4c46-8640-19d2460422fc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.680812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.681611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.681898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.682202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.684078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.685063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.685554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.686027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.687067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:03.687759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.689930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.693312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.695290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.701392 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 129/262] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:03.710985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.712062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 134/263] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:03.718081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.723430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86818dd8-bf7e-4096-9a75-a3256b612e89 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.728984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab2582-2f75-482f-9ede-604e19af9fb1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.729951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.731302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.731920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.732475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] PATH_INFO: `/v3/users/a8ffc830ec284bdc89f3564e3ca45a28` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.734062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] RBAC: Authorizing `identity:get_user(user_id=a8ffc830ec284bdc89f3564e3ca45a28)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.734347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.735355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.735780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.736171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.737715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.738016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.740130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.740747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 130/264] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/users/a8ffc830ec284bdc89f3564e3ca45a28 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:03.746312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 135/265] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.748451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.748724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.760073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190f87-50b8-4002-9e8f-e6bea70d5b01 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.760780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a97f-381e-4843-a74b-f61a1302008e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.765897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.766901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93608d44-de31-4550-ae96-25acae46a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.767031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.767457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.767876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.768169 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608d44-de31-4550-ae96-25acae46a249 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.768653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608d44-de31-4550-ae96-25acae46a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.769160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93608d44-de31-4550-ae96-25acae46a249 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.769696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.770331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93608d44-de31-4550-ae96-25acae46a249 admin admin] RBAC: Adding query filter params (role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=32f3e5c47d3d498f8772d7a0e1ee3437) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:03.770857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93608d44-de31-4550-ae96-25acae46a249 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.772329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.773092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93608d44-de31-4550-ae96-25acae46a249 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.774638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 136/266] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.780386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:03.785622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 131/267] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:03 2022] GET /identity/v3/role_assignments?user.id=32f3e5c47d3d498f8772d7a0e1ee3437&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:03.792678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac8ba4-cda0-42f1-bcee-a7bb38ff3864 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:03.797567 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff716e-5ce7-4322-82a1-53a525f8081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:03.798577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff716e-5ce7-4322-82a1-53a525f8081e admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:03.798859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff716e-5ce7-4322-82a1-53a525f8081e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:03.799137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff716e-5ce7-4322-82a1-53a525f8081e admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c/users/a8ffc830ec284bdc89f3564e3ca45a28/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:03.801863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff716e-5ce7-4322-82a1-53a525f8081e admin admin] RBAC: Authorizing `identity:create_grant(project_id=272bf5eaae46468b983a59aae152c09c, user_id=a8ffc830ec284bdc89f3564e3ca45a28, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:03.804927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff716e-5ce7-4322-82a1-53a525f8081e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:03.825260 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 137/268] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:03 2022] PUT /identity/v3/projects/272bf5eaae46468b983a59aae152c09c/users/a8ffc830ec284bdc89f3564e3ca45a28/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:23:05.973662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdee0a-c14c-45e3-9746-a492f1a2a5c0 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:05.974166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdee0a-c14c-45e3-9746-a492f1a2a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:05.974240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdee0a-c14c-45e3-9746-a492f1a2a5c0 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:05.976012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 132/269] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:05.981465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426332c3-4c88-46ab-9abb-b8cb42f6ca50 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:05.981894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426332c3-4c88-46ab-9abb-b8cb42f6ca50 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:05.982072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426332c3-4c88-46ab-9abb-b8cb42f6ca50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.000194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-426332c3-4c88-46ab-9abb-b8cb42f6ca50 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:06.001375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-426332c3-4c88-46ab-9abb-b8cb42f6ca50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:06.059495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 138/270] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:06.082629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdee0a-c14c-45e3-9746-a492f1a2a5c0 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.098948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdee0a-c14c-45e3-9746-a492f1a2a5c0 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.103422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.104533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.104919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.105270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.105376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268547-2574-40c1-bf72-4cc82f169b80 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.105580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268547-2574-40c1-bf72-4cc82f169b80 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.105858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268547-2574-40c1-bf72-4cc82f169b80 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.108167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 139/271] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:06.113924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48385861-0e72-4f68-b3d9-299a049fc274 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.114218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48385861-0e72-4f68-b3d9-299a049fc274 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.114492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48385861-0e72-4f68-b3d9-299a049fc274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.117773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:06.125502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:23:06.126938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 133/272] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:06.132345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.133526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-48385861-0e72-4f68-b3d9-299a049fc274 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:06.134699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-48385861-0e72-4f68-b3d9-299a049fc274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:06.142700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 140/273] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:06.142930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31fcdc-7f1b-47eb-a112-29ddbaca8ee1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.144142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723001a-df06-4f98-8fea-1bc3e1c46ab8 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.144432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723001a-df06-4f98-8fea-1bc3e1c46ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.144705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723001a-df06-4f98-8fea-1bc3e1c46ab8 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.146718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 141/274] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:06.147431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbccda-519e-48c2-a0e7-5c1410952b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.147697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a165c9a-b0d7-48b6-b1f4-ee597c096de0 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.148051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a165c9a-b0d7-48b6-b1f4-ee597c096de0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.148308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a165c9a-b0d7-48b6-b1f4-ee597c096de0 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.148424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbccda-519e-48c2-a0e7-5c1410952b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.148803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbccda-519e-48c2-a0e7-5c1410952b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.149168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbccda-519e-48c2-a0e7-5c1410952b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.149982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 142/275] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:06.150091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbccda-519e-48c2-a0e7-5c1410952b61 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:06.150465 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbccda-519e-48c2-a0e7-5c1410952b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.153921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbccda-519e-48c2-a0e7-5c1410952b61 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.154039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88927920-4aad-4666-8bda-e96ce34b7ad3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.154039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88927920-4aad-4666-8bda-e96ce34b7ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.154261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88927920-4aad-4666-8bda-e96ce34b7ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.161609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 134/276] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:06.164546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7a2c-b6ef-4837-b6b0-aad608832235 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.164976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7a2c-b6ef-4837-b6b0-aad608832235 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.165391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac7a2c-b6ef-4837-b6b0-aad608832235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.172490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-88927920-4aad-4666-8bda-e96ce34b7ad3 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:06.173673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-88927920-4aad-4666-8bda-e96ce34b7ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:06.181188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 143/277] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:06.181946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88927920-4aad-4666-8bda-e96ce34b7ad3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.182497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-45ac7a2c-b6ef-4837-b6b0-aad608832235 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:06.184180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-45ac7a2c-b6ef-4837-b6b0-aad608832235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:06.191212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88927920-4aad-4666-8bda-e96ce34b7ad3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.191500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 135/278] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:06.195442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.196278 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.196557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.196830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] PATH_INFO: `/v3/users/62aeda6b49954a9ea353846cffdf09b6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.198007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] RBAC: Authorizing `identity:get_user(user_id=62aeda6b49954a9ea353846cffdf09b6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.200267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac7a2c-b6ef-4837-b6b0-aad608832235 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.200740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.202414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 144/279] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/users/62aeda6b49954a9ea353846cffdf09b6 => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.207979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.210424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac7a2c-b6ef-4837-b6b0-aad608832235 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.214754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.215573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.215856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.216134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.217301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.218981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.220129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fac669-af7c-4442-9d88-1dd4942a1cfb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.220577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 136/280] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.221310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.224420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.225196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.225485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.225765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.231055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9974ac-6cba-4b64-8b76-a0d178440747 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.235202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.235998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.236276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.236397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:06.236551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.237690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.239680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.241256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 137/281] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.241974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.243163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:06.246444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 145/282] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:06.247434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.251715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14c78-340d-4c8f-a247-43ed5d352d75 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.255847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.256562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.256842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.257116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.257776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee388db-1033-4e16-ad3c-069a7db0fc74 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.261999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.262619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.262901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.263178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.263927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.265870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.267313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:06.274091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:06.275223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 138/283] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:06.275985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.286657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 146/284] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:06 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:06.287499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.297667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c888b07-7ce5-4447-93ec-50e53f5906bf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.298930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd27518-e20d-4c22-a9ff-744c16dbf909 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.302272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.302946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.303233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.303425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.303535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.304318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.304429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:06.304609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.304701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.304879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c/users/62aeda6b49954a9ea353846cffdf09b6/roles/f4d66549fc74428f879ff5c3f3f9accc` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.306267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.306975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272bf5eaae46468b983a59aae152c09c, user_id=62aeda6b49954a9ea353846cffdf09b6, role_id=f4d66549fc74428f879ff5c3f3f9accc)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.310289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.316358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 147/285] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.317234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.327622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf892de-1b5f-43ec-aab8-97e6adbf543f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.328989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 139/286] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:06 2022] PUT /identity/v3/projects/272bf5eaae46468b983a59aae152c09c/users/62aeda6b49954a9ea353846cffdf09b6/roles/f4d66549fc74428f879ff5c3f3f9accc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:06.329815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.406563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4837b54-f06b-4bfb-8597-9402a398c6c1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.411820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.412987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.413377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.413808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] PATH_INFO: `/v3/users/28f07367c80c4bdcba2abc57916a8b2e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.419528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.420486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.420920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.421374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.422321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:06.422783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.425446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.431842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] RBAC: Authorizing `identity:get_user(user_id=28f07367c80c4bdcba2abc57916a8b2e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.435104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.437338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 140/287] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/users/28f07367c80c4bdcba2abc57916a8b2e => generated 293 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.438578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 148/288] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.444267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.444744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.455519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c60e54-a611-4bc4-85b2-95dcda60b319 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.458104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e7796-866a-4165-9131-2221823dc88c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.460361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.461098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.461383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.461661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.462516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, user.id=28f07367c80c4bdcba2abc57916a8b2e, scope.system=all) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:06.462829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.464839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.465095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.466229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.466716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.467481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] PATH_INFO: `/v3/users/a8ffc830ec284bdc89f3564e3ca45a28` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.469061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] RBAC: Authorizing `identity:get_user(user_id=a8ffc830ec284bdc89f3564e3ca45a28)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.472600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.474372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 149/289] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/users/a8ffc830ec284bdc89f3564e3ca45a28 => generated 297 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.474862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 141/290] 10.222.0.60 () {56 vars in 1329 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/role_assignments?user.id=28f07367c80c4bdcba2abc57916a8b2e&scope.system=all&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.480696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.492032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d627b7-0f6c-4a36-bfdf-e5c740e5aa3d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.496799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.497479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.497759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.498038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.510952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.513339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.530720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 150/291] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:06.536935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.550514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606706fc-55ff-4248-9443-6f4a2e368904 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.560122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd584a-c4ae-43bb-a078-d55da7de92d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.561115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd584a-c4ae-43bb-a078-d55da7de92d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.561491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd584a-c4ae-43bb-a078-d55da7de92d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.561843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd584a-c4ae-43bb-a078-d55da7de92d3 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.563293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd584a-c4ae-43bb-a078-d55da7de92d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.565532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd584a-c4ae-43bb-a078-d55da7de92d3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.567624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 142/292] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:06.573738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:06.583556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f15df1-aebd-4344-bbfc-362fc9c0888f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:06.588671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd7c45-85bd-458d-9299-4f3ad0aea1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:06.590249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd7c45-85bd-458d-9299-4f3ad0aea1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:06.590778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd7c45-85bd-458d-9299-4f3ad0aea1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:06.591256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd7c45-85bd-458d-9299-4f3ad0aea1b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:06.592501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd7c45-85bd-458d-9299-4f3ad0aea1b9 admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=a8ffc830ec284bdc89f3564e3ca45a28) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:06.593039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd7c45-85bd-458d-9299-4f3ad0aea1b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:06.594991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd7c45-85bd-458d-9299-4f3ad0aea1b9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:06.602996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 151/293] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:06 2022] GET /identity/v3/role_assignments?user.id=a8ffc830ec284bdc89f3564e3ca45a28&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:08.634530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc756c-2747-4959-b4d2-470852b02ca3 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.635055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc756c-2747-4959-b4d2-470852b02ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.635055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc756c-2747-4959-b4d2-470852b02ca3 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.637265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 143/294] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:08.642983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3fda6-4a82-4cb8-80fc-9731d51c5365 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.643612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3fda6-4a82-4cb8-80fc-9731d51c5365 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.643612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3fda6-4a82-4cb8-80fc-9731d51c5365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.663200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-43d3fda6-4a82-4cb8-80fc-9731d51c5365 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:08.664451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-43d3fda6-4a82-4cb8-80fc-9731d51c5365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:08.673036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 152/295] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:08.696681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc756c-2747-4959-b4d2-470852b02ca3 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.709037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc756c-2747-4959-b4d2-470852b02ca3 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.713379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990c66c-429b-4822-995b-40b1827ac672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.714197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990c66c-429b-4822-995b-40b1827ac672 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.714481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990c66c-429b-4822-995b-40b1827ac672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.714759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990c66c-429b-4822-995b-40b1827ac672 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.725596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990c66c-429b-4822-995b-40b1827ac672 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:08.733015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9990c66c-429b-4822-995b-40b1827ac672 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:23:08.734218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 144/296] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:08.739902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3fda6-4a82-4cb8-80fc-9731d51c5365 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.744677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4796f6-273b-40cd-a6d9-c38f3dfdbee0 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.746353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4796f6-273b-40cd-a6d9-c38f3dfdbee0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.746835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4796f6-273b-40cd-a6d9-c38f3dfdbee0 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.749101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 145/297] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:08.750392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3fda6-4a82-4cb8-80fc-9731d51c5365 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.753932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.754592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.754878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.755155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.755418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdfbda-9cd5-4959-aad6-fcd522ddd632 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.755913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdfbda-9cd5-4959-aad6-fcd522ddd632 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.756013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:08.756242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.756666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdfbda-9cd5-4959-aad6-fcd522ddd632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.757835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.768077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 153/298] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:08.773791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.778227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a1bdfbda-9cd5-4959-aad6-fcd522ddd632 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:08.780315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a1bdfbda-9cd5-4959-aad6-fcd522ddd632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:08.783489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7221e91-9f6d-42ac-92d5-372bf246b23d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.787788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.788632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.788914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.789188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] PATH_INFO: `/v3/users/62aeda6b49954a9ea353846cffdf09b6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.789544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 146/299] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:08.795298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] RBAC: Authorizing `identity:get_user(user_id=62aeda6b49954a9ea353846cffdf09b6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.795298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.795548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54ac7-876b-4449-a03f-cf341661b04a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.795548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54ac7-876b-4449-a03f-cf341661b04a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.795548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54ac7-876b-4449-a03f-cf341661b04a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.795817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 154/300] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/users/62aeda6b49954a9ea353846cffdf09b6 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:08.795910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 147/301] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:08.800384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.800882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35a4f1-60a1-4941-b7da-dc3148b26330 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.801267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35a4f1-60a1-4941-b7da-dc3148b26330 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.801564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35a4f1-60a1-4941-b7da-dc3148b26330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.810595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eb9ff-af1c-40be-9a63-6c521a6aeb70 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.815176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.815926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.816279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.816629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.820399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-eb35a4f1-60a1-4941-b7da-dc3148b26330 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:08.821583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-eb35a4f1-60a1-4941-b7da-dc3148b26330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:08.825090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.826833 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.829634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 148/302] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:08.832855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35a4f1-60a1-4941-b7da-dc3148b26330 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.839740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 155/303] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:08.841679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.843526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35a4f1-60a1-4941-b7da-dc3148b26330 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.852756 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142eaf-aab8-4555-a56d-75e57d1b293f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.854490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.856068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.856583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.857093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.857852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.858686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.858969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.859247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.860466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.862502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.864210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 156/304] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:08.864969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.874987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b8f46-0064-44d5-87b7-bf539069dace admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.875479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:08.879431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.880284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.880571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.880846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.882353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:23:08.883589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 149/305] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:08.883589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.893159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:08.898504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c13a5-fbde-4c5a-ae6d-42c69806b851 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.899950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:08.906125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 157/306] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:08.906125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.908033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.908659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.908940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.909215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.910049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] RBAC: Adding query filter params (role.id=f4d66549fc74428f879ff5c3f3f9accc, scope.project.id=272bf5eaae46468b983a59aae152c09c, user.id=62aeda6b49954a9ea353846cffdf09b6) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:08.910362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.912268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.916667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b5b31-62e2-470b-89e3-f9fba720296e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.919132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 150/307] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/role_assignments?user.id=62aeda6b49954a9ea353846cffdf09b6&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=f4d66549fc74428f879ff5c3f3f9accc => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:08.919944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.921614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711ee54-93a8-448e-99aa-9a798bf0fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.922295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711ee54-93a8-448e-99aa-9a798bf0fe46 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.922586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711ee54-93a8-448e-99aa-9a798bf0fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.922861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711ee54-93a8-448e-99aa-9a798bf0fe46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.923661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711ee54-93a8-448e-99aa-9a798bf0fe46 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:08.923972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711ee54-93a8-448e-99aa-9a798bf0fe46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.925671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711ee54-93a8-448e-99aa-9a798bf0fe46 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.930431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b67ce-6d82-4303-9fe1-8af4f9fa2434 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.939927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 158/308] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:08.940142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271f851-17f2-449b-8d6b-17dfc24533a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.940142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271f851-17f2-449b-8d6b-17dfc24533a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.940323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3149-3e35-4c33-99c7-b638d87c8363 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.940404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271f851-17f2-449b-8d6b-17dfc24533a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.940483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3149-3e35-4c33-99c7-b638d87c8363 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.940941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271f851-17f2-449b-8d6b-17dfc24533a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.941100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3149-3e35-4c33-99c7-b638d87c8363 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.941241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271f851-17f2-449b-8d6b-17dfc24533a0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:08.941241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271f851-17f2-449b-8d6b-17dfc24533a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.941500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 159/309] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:08.941644 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271f851-17f2-449b-8d6b-17dfc24533a0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.941792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3149-3e35-4c33-99c7-b638d87c8363 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.951665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 151/310] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:08.956163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3149-3e35-4c33-99c7-b638d87c8363 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:08.957805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817331-66d0-4ae9-8cca-2a3732814daa None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.958121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817331-66d0-4ae9-8cca-2a3732814daa None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.958428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817331-66d0-4ae9-8cca-2a3732814daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.961287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:08.962382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:08.962721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:08.963061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] PATH_INFO: `/v3/users/8826b96056b547e9bf8fe70446caa9a2` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:08.978100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d0817331-66d0-4ae9-8cca-2a3732814daa None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:08.979429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d0817331-66d0-4ae9-8cca-2a3732814daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:08.981501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] RBAC: Authorizing `identity:get_user(user_id=8826b96056b547e9bf8fe70446caa9a2)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:08.984234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:08.991046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 160/311] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/users/8826b96056b547e9bf8fe70446caa9a2 => generated 293 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:08.991046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.994177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 152/312] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:08.994177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817331-66d0-4ae9-8cca-2a3732814daa None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:08.998655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fb08-9916-46b9-acbe-b65443856ba3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:09.004403 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:09.005003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817331-66d0-4ae9-8cca-2a3732814daa None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:09.005281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:09.005566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:09.005846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] PATH_INFO: `/v3/users/28f07367c80c4bdcba2abc57916a8b2e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:09.007198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] RBAC: Authorizing `identity:get_user(user_id=28f07367c80c4bdcba2abc57916a8b2e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:09.009392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:09.010522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:09.011114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 161/313] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/users/28f07367c80c4bdcba2abc57916a8b2e => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:09.011570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:09.012015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:09.012431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:09.013432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] RBAC: Adding query filter params (role.id=f4d66549fc74428f879ff5c3f3f9accc, user.id=8826b96056b547e9bf8fe70446caa9a2, scope.system=all) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:09.013889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:09.016137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:09.016897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:09.022344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 153/314] 10.222.0.60 () {56 vars in 1329 bytes} [Mon Feb 7 20:23:08 2022] GET /identity/v3/role_assignments?user.id=8826b96056b547e9bf8fe70446caa9a2&scope.system=all&role.id=f4d66549fc74428f879ff5c3f3f9accc => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:09.023451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:09.027451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a2093-c405-450d-8b28-c7635ae6ff3c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:09.032440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4b377-9060-4236-80e2-e083cb743217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:09.033330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b377-9060-4236-80e2-e083cb743217 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:09.033635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b377-9060-4236-80e2-e083cb743217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:09.033893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b377-9060-4236-80e2-e083cb743217 admin admin] PATH_INFO: `/v3/system/users/28f07367c80c4bdcba2abc57916a8b2e/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:09.035623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b377-9060-4236-80e2-e083cb743217 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=28f07367c80c4bdcba2abc57916a8b2e, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:09.036589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1a256-5ba4-4f21-b601-8c853153979c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:09.036783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-59a4b377-9060-4236-80e2-e083cb743217 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:09.036783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:09.036783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:09.037731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b377-9060-4236-80e2-e083cb743217 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:09.042157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:09.044302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:09.044881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:09.045201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:09.048485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:09.050537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:09.055456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 154/316] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:09.055800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 162/316] 10.222.0.60 () {58 vars in 1355 bytes} [Mon Feb 7 20:23:09 2022] PUT /identity/v3/system/users/28f07367c80c4bdcba2abc57916a8b2e/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:23:09.063425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:09.078266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4def7a0-744b-4545-a249-50e06515cf8e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:09.083310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9319994-fa4d-4b6f-8429-8cb17f16d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:09.084022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9319994-fa4d-4b6f-8429-8cb17f16d19e admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:09.084319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9319994-fa4d-4b6f-8429-8cb17f16d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:09.084668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9319994-fa4d-4b6f-8429-8cb17f16d19e admin admin] PATH_INFO: `/v3/groups` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:09.086021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9319994-fa4d-4b6f-8429-8cb17f16d19e admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:09.087433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-d9319994-fa4d-4b6f-8429-8cb17f16d19e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:09.087433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:09.087433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:09.088847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9319994-fa4d-4b6f-8429-8cb17f16d19e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:09.110283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 155/317] 10.222.0.60 () {60 vars in 1155 bytes} [Mon Feb 7 20:23:09 2022] POST /identity/v3/groups => generated 229 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:11.269883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabf3c-a0c8-444f-a345-162367d4c561 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.270384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabf3c-a0c8-444f-a345-162367d4c561 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.270460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbabf3c-a0c8-444f-a345-162367d4c561 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.272335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 163/318] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:11.277595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4390c-a2a1-4a97-a80a-4aad2807d7b4 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.278020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4390c-a2a1-4a97-a80a-4aad2807d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.278190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4390c-a2a1-4a97-a80a-4aad2807d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.286125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4de9b-b8ec-4839-b3de-683a84647585 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.286125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4de9b-b8ec-4839-b3de-683a84647585 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.286125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4de9b-b8ec-4839-b3de-683a84647585 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.288678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 164/319] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:11.295681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b06b-9678-4cc1-a4eb-435425f96c50 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.295977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b06b-9678-4cc1-a4eb-435425f96c50 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.296266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b06b-9678-4cc1-a4eb-435425f96c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.296475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-baa4390c-a2a1-4a97-a80a-4aad2807d7b4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:11.297826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-baa4390c-a2a1-4a97-a80a-4aad2807d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:11.306065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 156/320] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:11.318272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4dd7b06b-9678-4cc1-a4eb-435425f96c50 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:11.319484 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4dd7b06b-9678-4cc1-a4eb-435425f96c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:11.331539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 165/321] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:11.331697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4390c-a2a1-4a97-a80a-4aad2807d7b4 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.338608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4390c-a2a1-4a97-a80a-4aad2807d7b4 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.343128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f9314-200d-4b52-a7ad-1cfaad98d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.343945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9314-200d-4b52-a7ad-1cfaad98d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.344231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9314-200d-4b52-a7ad-1cfaad98d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.344508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9314-200d-4b52-a7ad-1cfaad98d2d5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.352021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b06b-9678-4cc1-a4eb-435425f96c50 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.355039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f9314-200d-4b52-a7ad-1cfaad98d2d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:11.360910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b06b-9678-4cc1-a4eb-435425f96c50 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.362083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-1c3f9314-200d-4b52-a7ad-1cfaad98d2d5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:23:11.363274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 157/322] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:11.364614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1023704-c58a-4e7e-a21b-7654bbe9d150 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.364907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1023704-c58a-4e7e-a21b-7654bbe9d150 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.365185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1023704-c58a-4e7e-a21b-7654bbe9d150 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.365342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928a50f-9df2-4c6c-b045-0ffbabc135e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.366118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a50f-9df2-4c6c-b045-0ffbabc135e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.366397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a50f-9df2-4c6c-b045-0ffbabc135e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.366670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a50f-9df2-4c6c-b045-0ffbabc135e2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.367159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 158/323] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:11.369117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1023704-c58a-4e7e-a21b-7654bbe9d150 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.377987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928a50f-9df2-4c6c-b045-0ffbabc135e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:11.381425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1023704-c58a-4e7e-a21b-7654bbe9d150 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.384815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-0928a50f-9df2-4c6c-b045-0ffbabc135e2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:11.385555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.386674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 166/324] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:11.386791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.386981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.387255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.388040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:11.388348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.388661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200e499-c31f-4c0b-a615-c4ee99caff2d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.389137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200e499-c31f-4c0b-a615-c4ee99caff2d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.389501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200e499-c31f-4c0b-a615-c4ee99caff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.390478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.399687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 159/325] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:11.401208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.409858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b200e499-c31f-4c0b-a615-c4ee99caff2d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:11.411154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b200e499-c31f-4c0b-a615-c4ee99caff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:11.412224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a8de-b3f4-44ed-b603-2c4009afbba7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.416570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.417208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.417488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.417765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.418618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:11.419038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.423441 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 167/326] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:11.423441 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200e499-c31f-4c0b-a615-c4ee99caff2d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.423640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.429221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 160/327] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:11.434424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200e499-c31f-4c0b-a615-c4ee99caff2d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.436488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.438892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.439848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.440137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.440416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] PATH_INFO: `/v3/users/8826b96056b547e9bf8fe70446caa9a2` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.441727 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] RBAC: Authorizing `identity:get_user(user_id=8826b96056b547e9bf8fe70446caa9a2)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.443896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.445502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 168/328] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/users/8826b96056b547e9bf8fe70446caa9a2 => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:11.445677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3e82a-1fb0-4c8d-b5d4-54a23f7d2ddd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.446475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.454111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.454957 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.455235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.455553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] PATH_INFO: `/v3/users/28f07367c80c4bdcba2abc57916a8b2e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.456744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] RBAC: Authorizing `identity:get_user(user_id=28f07367c80c4bdcba2abc57916a8b2e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.458835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.460428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 161/329] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/users/28f07367c80c4bdcba2abc57916a8b2e => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:11.460669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce247-43a6-4f30-b7df-3b34a2b20788 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.462116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.465629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.466403 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.466689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.466963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.468158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.469821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.471533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ef1c-e15f-4b1d-9b9c-e0f22ba7d343 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.471638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 169/330] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:11.472139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.475491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.476297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.476575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.476852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] PATH_INFO: `/v3/system/users/8826b96056b547e9bf8fe70446caa9a2/roles/f4d66549fc74428f879ff5c3f3f9accc` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.478311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8826b96056b547e9bf8fe70446caa9a2, role_id=f4d66549fc74428f879ff5c3f3f9accc)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.479310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:11.479310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:11.479310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:11.480756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.482555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef14ca-69de-49fa-b95d-d373936c278b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.487909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43cf4e-8190-4087-9e3a-24fa94a1c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.488658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43cf4e-8190-4087-9e3a-24fa94a1c41c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.489084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43cf4e-8190-4087-9e3a-24fa94a1c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.489428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43cf4e-8190-4087-9e3a-24fa94a1c41c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.489720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 162/331] 10.222.0.60 () {58 vars in 1355 bytes} [Mon Feb 7 20:23:11 2022] PUT /identity/v3/system/users/8826b96056b547e9bf8fe70446caa9a2/roles/f4d66549fc74428f879ff5c3f3f9accc => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:11.490307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43cf4e-8190-4087-9e3a-24fa94a1c41c admin admin] RBAC: Adding query filter params (role.id=6d0818e098ae461b8c0b30d4061e0f68, user.id=28f07367c80c4bdcba2abc57916a8b2e, scope.system=all) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:11.490542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:11.490680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43cf4e-8190-4087-9e3a-24fa94a1c41c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.492549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43cf4e-8190-4087-9e3a-24fa94a1c41c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.501640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28035819-6b45-447c-9d28-20cbdb2f2534 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:11.506466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9ff80-744d-4ed7-9180-cacdbf8b5e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:11.507148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ff80-744d-4ed7-9180-cacdbf8b5e1c admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:11.507450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ff80-744d-4ed7-9180-cacdbf8b5e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:11.507731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ff80-744d-4ed7-9180-cacdbf8b5e1c admin admin] PATH_INFO: `/v3/groups` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:11.508450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9ff80-744d-4ed7-9180-cacdbf8b5e1c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:11.510404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9ff80-744d-4ed7-9180-cacdbf8b5e1c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:11.513268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 170/332] 10.222.0.60 () {56 vars in 1329 bytes} [Mon Feb 7 20:23:11 2022] GET /identity/v3/role_assignments?user.id=28f07367c80c4bdcba2abc57916a8b2e&scope.system=all&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 510 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:11.528481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 163/333] 10.222.0.60 () {60 vars in 1155 bytes} [Mon Feb 7 20:23:11 2022] POST /identity/v3/groups => generated 226 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:14.390847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d86b-32f7-4da4-9467-bca453a1610e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.391733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d86b-32f7-4da4-9467-bca453a1610e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.391733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d86b-32f7-4da4-9467-bca453a1610e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.393189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 171/334] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:14.404852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbc1f-5e2d-4080-8354-e2b59399001f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.405782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbc1f-5e2d-4080-8354-e2b59399001f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.406534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbc1f-5e2d-4080-8354-e2b59399001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.431693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-71acbc1f-5e2d-4080-8354-e2b59399001f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:14.433780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-71acbc1f-5e2d-4080-8354-e2b59399001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:14.446965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 164/335] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:14.490895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d86b-32f7-4da4-9467-bca453a1610e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.510280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d86b-32f7-4da4-9467-bca453a1610e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.515115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b1fb2-cbda-4936-9e2b-b69e42f8f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.515989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b1fb2-cbda-4936-9e2b-b69e42f8f587 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.516269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b1fb2-cbda-4936-9e2b-b69e42f8f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.516541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b1fb2-cbda-4936-9e2b-b69e42f8f587 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.529917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b1fb2-cbda-4936-9e2b-b69e42f8f587 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:14.537352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e06b1fb2-cbda-4936-9e2b-b69e42f8f587 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:14.538858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 172/336] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:14.545429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acbc1f-5e2d-4080-8354-e2b59399001f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.561862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acbc1f-5e2d-4080-8354-e2b59399001f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.570689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.571787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.572272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.572757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.573998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:14.574547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.576466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.581540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9623bb-bf3c-4330-9424-2589ab485b24 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.581861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9623bb-bf3c-4330-9424-2589ab485b24 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.582100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9623bb-bf3c-4330-9424-2589ab485b24 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.584138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 173/337] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:14.590048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3bf0-37a0-4cf6-96fd-e97b09aa46cc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.590332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3bf0-37a0-4cf6-96fd-e97b09aa46cc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.590600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3bf0-37a0-4cf6-96fd-e97b09aa46cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.592579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 165/338] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:14.598380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.614387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1291f-c6fd-44c9-b3d4-679871c53fe8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.622327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c56c3bf0-37a0-4cf6-96fd-e97b09aa46cc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:14.625079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c56c3bf0-37a0-4cf6-96fd-e97b09aa46cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:14.625881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.626762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.627248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.627752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.641896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.644332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 174/339] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:14.645292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.646273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0b8a5-6560-4f1c-847c-9d1b69719205 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.646994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0b8a5-6560-4f1c-847c-9d1b69719205 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.647691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0b8a5-6560-4f1c-847c-9d1b69719205 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.649628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 175/340] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:14.655237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278069-12a7-4508-bcef-4fa1364e36cb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.655793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278069-12a7-4508-bcef-4fa1364e36cb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.656567 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278069-12a7-4508-bcef-4fa1364e36cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.662461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 166/341] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:14.678000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.684290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-98278069-12a7-4508-bcef-4fa1364e36cb None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:14.685739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-98278069-12a7-4508-bcef-4fa1364e36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:14.692759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1318-2dbf-4955-9095-2097dc22eb11 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.694267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 176/342] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:14.695561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98278069-12a7-4508-bcef-4fa1364e36cb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.704995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.705794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.706078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.706357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.706751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98278069-12a7-4508-bcef-4fa1364e36cb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.713485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.714957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.715628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.716114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.717525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.719849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.721763 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 177/343] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:14.729382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.736551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:14.740190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd2168-4c7b-4006-85b2-54b480a14614 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.743257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:14.745775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.747311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.747850 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.748337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.748579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 167/344] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:14.749367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.756058 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.757383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:14.757383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:14.757383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:14.761096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.763080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 178/345] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:14.764147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.773903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4165f-21a1-4084-a0ea-d9a663370b90 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.781076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6a238-7477-408a-954c-050b4a42d3b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.786189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.787108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.787621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.788117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.789355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:14.789880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.791725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.793514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.794315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.794599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.794876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.804461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 179/346] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:14.805704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.816895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d122463-4c8f-4200-8085-1fe8291a3935 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.821601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.822510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.823005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.823566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.824626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=630217dacb45427f8c81275638cd7197) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:14.825153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.827199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.828362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:14.833734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 180/347] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:14.834889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.835287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 20:23:14.836541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 168/348] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:14.842964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.847191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cfbd6-189a-4c0c-8bae-ac26c8ae8d3f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.859105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788bad4-3075-4db8-8514-7a1f6559375a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.860840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.862293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.863025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.863668 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.875996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.876699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.877001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.877772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.878065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:14.878377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.880097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.881137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.883168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.893556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 181/349] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:14.902343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.903628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 169/350] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:14.909426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.914273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4f312-3078-4d16-8264-bfa5cc9ae3b6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.924906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fa9da-5ed8-42b8-b208-923986afac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.925932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc47bbc-9748-493a-9d5e-a36ce0eed126 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.926377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa9da-5ed8-42b8-b208-923986afac70 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.926937 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa9da-5ed8-42b8-b208-923986afac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.927452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa9da-5ed8-42b8-b208-923986afac70 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.928977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fa9da-5ed8-42b8-b208-923986afac70 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.931305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fa9da-5ed8-42b8-b208-923986afac70 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.934111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 182/351] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:14.935887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae2f0e-28cb-4f65-886c-a7476025f508 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.936406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae2f0e-28cb-4f65-886c-a7476025f508 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.937048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae2f0e-28cb-4f65-886c-a7476025f508 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.938174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.939082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.939371 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.939680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] PATH_INFO: `/v3/users/8826b96056b547e9bf8fe70446caa9a2` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.940407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 183/352] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:14.941003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=8826b96056b547e9bf8fe70446caa9a2)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.943147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.946699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 170/353] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/users/8826b96056b547e9bf8fe70446caa9a2 => generated 293 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:14.949693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f88607-1593-4aa9-8440-5acb315e6f91 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.950276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f88607-1593-4aa9-8440-5acb315e6f91 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.950754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f88607-1593-4aa9-8440-5acb315e6f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.954340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.965330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ac9bd-6668-41ae-bd23-56bbcd1fe7d7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:14.971127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:14.972044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:14.972333 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:14.972614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:14.973841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:14.974387 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-72f88607-1593-4aa9-8440-5acb315e6f91 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:14.974885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:14.974885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:14.974885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:14.976105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:14.977384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-72f88607-1593-4aa9-8440-5acb315e6f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:14.977788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 171/354] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:14.978589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:14.994081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 184/355] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:14.995789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f88607-1593-4aa9-8440-5acb315e6f91 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.002014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222398b-597c-4461-9c24-4d7df8bcd0f7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.012153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.013201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.015087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.015762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.015989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f88607-1593-4aa9-8440-5acb315e6f91 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.017803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] RBAC: Adding query filter params (role.id=f4d66549fc74428f879ff5c3f3f9accc, user.id=8826b96056b547e9bf8fe70446caa9a2, scope.system=all) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:15.019139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.021593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.026658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.027730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.028213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.028703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.029767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=630217dacb45427f8c81275638cd7197) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:15.030289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.032682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.041217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 185/356] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.042510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.056166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 172/357] 10.222.0.60 () {56 vars in 1329 bytes} [Mon Feb 7 20:23:14 2022] GET /identity/v3/role_assignments?user.id=8826b96056b547e9bf8fe70446caa9a2&scope.system=all&role.id=f4d66549fc74428f879ff5c3f3f9accc => generated 510 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.066145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c323-1261-48c3-8bc7-881f3bf65280 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.072051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.072876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.073157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.074015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.090623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:15.097707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:15.099267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 186/358] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:15.108783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.138688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0db67d-165d-4756-b4d6-e117566c46b4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.151202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.151898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.152183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.152464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.153243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:15.153562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.155240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.172323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 173/359] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.178305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.193318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3c2b-04d7-4abc-b72e-bdf580a62bc9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.201800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.202479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.202758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.203035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.217164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.219001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.234570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 187/360] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:15.240356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.257016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4e70-99dc-4faf-834d-e0c78ead1e84 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.267929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.268815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.269097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.269381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.276539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.278724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.280664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 174/361] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.286685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.301458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb8f5b-71fa-466c-af5c-adbf07ba46f7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.309835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9280b-a33a-4663-84a6-d97e217e46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.310729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9280b-a33a-4663-84a6-d97e217e46e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.311016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9280b-a33a-4663-84a6-d97e217e46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.311299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9280b-a33a-4663-84a6-d97e217e46e7 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.313392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9280b-a33a-4663-84a6-d97e217e46e7 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.315359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9280b-a33a-4663-84a6-d97e217e46e7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.317463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 188/362] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.323930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.340715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98bbc0-a95b-4387-a34a-0191f95461ff admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.347031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0012b7a-e7bd-401f-89d9-05d691b60d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.347730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012b7a-e7bd-401f-89d9-05d691b60d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.348014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012b7a-e7bd-401f-89d9-05d691b60d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.348291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0012b7a-e7bd-401f-89d9-05d691b60d5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.349149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012b7a-e7bd-401f-89d9-05d691b60d5f admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=272bf5eaae46468b983a59aae152c09c) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:15.349463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012b7a-e7bd-401f-89d9-05d691b60d5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.351331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0012b7a-e7bd-401f-89d9-05d691b60d5f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.358598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce40c3-c98b-412c-a4d2-eee130d40f08 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.359189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce40c3-c98b-412c-a4d2-eee130d40f08 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.359500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce40c3-c98b-412c-a4d2-eee130d40f08 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.361063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 175/363] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.361456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 189/364] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:15.366940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e777e2f-e92d-43c6-bcfa-c8f34aa14bde None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.367232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e777e2f-e92d-43c6-bcfa-c8f34aa14bde None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.367529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e777e2f-e92d-43c6-bcfa-c8f34aa14bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.387697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9e777e2f-e92d-43c6-bcfa-c8f34aa14bde None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:15.389848 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9e777e2f-e92d-43c6-bcfa-c8f34aa14bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:15.405467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 176/365] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:15.441444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce40c3-c98b-412c-a4d2-eee130d40f08 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.460206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce40c3-c98b-412c-a4d2-eee130d40f08 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.465347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.466733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.467020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.467297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.486142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:15.493717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:15.495343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 190/366] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:15.501205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e777e2f-e92d-43c6-bcfa-c8f34aa14bde None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.511441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e777e2f-e92d-43c6-bcfa-c8f34aa14bde None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.518954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.519689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.519974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.520254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.521036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:15.521348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.522967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.533434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 177/367] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.539035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.550425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe102d7-d8c8-4629-82fe-e72d11485678 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.556679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.557345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.557712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.557961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.568589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.570386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.583085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 191/368] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:15.589568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.605166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c7277-1d0d-43ee-911d-79c0f933fa82 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.612196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.613047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.613327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.613605 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.614914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.617014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.618680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 178/369] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.624783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.633806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df39c84-cfd1-4058-9268-6b2627a474e5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.642589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ef29-6d1b-46bb-8df2-440cacc6d900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.643459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ef29-6d1b-46bb-8df2-440cacc6d900 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.643741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ef29-6d1b-46bb-8df2-440cacc6d900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.644013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ef29-6d1b-46bb-8df2-440cacc6d900 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.645929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ef29-6d1b-46bb-8df2-440cacc6d900 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.647847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ef29-6d1b-46bb-8df2-440cacc6d900 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.649510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 192/370] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:15.655768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:15.666049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08152f1a-8c81-4bc5-b85e-b2eee15e51a6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:15.676955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffc149-dfef-4256-88c4-d21b13da851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:15.677628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc149-dfef-4256-88c4-d21b13da851a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:15.677914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc149-dfef-4256-88c4-d21b13da851a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:15.678196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc149-dfef-4256-88c4-d21b13da851a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:15.679050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffc149-dfef-4256-88c4-d21b13da851a admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=272bf5eaae46468b983a59aae152c09c) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:15.679367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffc149-dfef-4256-88c4-d21b13da851a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:15.681249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffc149-dfef-4256-88c4-d21b13da851a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:15.692910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 179/371] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:15 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:16.586606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c27fd-da59-4dc3-bd1f-78dd7dd013b9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.587287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c27fd-da59-4dc3-bd1f-78dd7dd013b9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.587287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c27fd-da59-4dc3-bd1f-78dd7dd013b9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.589750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 193/372] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:16.595075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac62f-c06e-4449-8d80-bba2242b7eae None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.595600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac62f-c06e-4449-8d80-bba2242b7eae None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.595790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ac62f-c06e-4449-8d80-bba2242b7eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.614097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-706ac62f-c06e-4449-8d80-bba2242b7eae None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:16.615299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-706ac62f-c06e-4449-8d80-bba2242b7eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:16.633880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 180/373] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:16.678753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c27fd-da59-4dc3-bd1f-78dd7dd013b9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:16.697773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c27fd-da59-4dc3-bd1f-78dd7dd013b9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:16.708422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:16.709763 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.710282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.710793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.728609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:16.736243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:16.737741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 194/374] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:16.743520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac62f-c06e-4449-8d80-bba2242b7eae None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:16.757290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ac62f-c06e-4449-8d80-bba2242b7eae None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:16.765852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:16.766516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.766800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.767083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.767909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:16.768222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:16.769842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:16.783515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 181/375] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:16.789148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:16.803655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ffee-5e79-43da-a74f-f10b48c4eb36 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:16.811332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:16.812015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.812295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.812572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.821647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:16.823451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:16.833390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 195/376] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:16.839825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:16.855432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eb43b-082c-4891-bb54-894ff755cd8d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:16.870754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:16.870754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.870754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.870754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.871560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:16.875103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:16.875359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 182/377] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:16 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:16.881313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:16.890472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af491ff-4c60-41fa-b8b0-1a976cc74b3a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:16.902628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ac423-a1d7-4b37-b9b8-ba548eeedb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:16.903506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ac423-a1d7-4b37-b9b8-ba548eeedb92 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.903787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ac423-a1d7-4b37-b9b8-ba548eeedb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.904060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ac423-a1d7-4b37-b9b8-ba548eeedb92 admin admin] PATH_INFO: `/v3/groups/dc37c95ad11c4583b3b1e6aa189afcce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.913898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ac423-a1d7-4b37-b9b8-ba548eeedb92 admin admin] RBAC: Authorizing `identity:get_group(group_id=dc37c95ad11c4583b3b1e6aa189afcce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:16.915837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ac423-a1d7-4b37-b9b8-ba548eeedb92 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:16.917998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 196/378] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:16 2022] GET /identity/v3/groups/dc37c95ad11c4583b3b1e6aa189afcce => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:16.924126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:16.940402 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7f527-5766-40ac-97cd-cf178fcdbd61 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:16.950246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ef1c6-847d-4f6c-8765-250ea077987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:16.950899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ef1c6-847d-4f6c-8765-250ea077987b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:16.951181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ef1c6-847d-4f6c-8765-250ea077987b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:16.951485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ef1c6-847d-4f6c-8765-250ea077987b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:16.952332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ef1c6-847d-4f6c-8765-250ea077987b admin admin] RBAC: Adding query filter params (group.id=dc37c95ad11c4583b3b1e6aa189afcce, role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=1fd85593742943409724ee224daef15b) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:16.952646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ef1c6-847d-4f6c-8765-250ea077987b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:16.954495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ef1c6-847d-4f6c-8765-250ea077987b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:16.966575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 183/379] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:16 2022] GET /identity/v3/role_assignments?group.id=dc37c95ad11c4583b3b1e6aa189afcce&scope.project.id=1fd85593742943409724ee224daef15b&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:17.969993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0482-1e6b-4da6-8228-4ae1dfe06702 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:17.970564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0482-1e6b-4da6-8228-4ae1dfe06702 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:17.970564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0482-1e6b-4da6-8228-4ae1dfe06702 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:17.972651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 197/380] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:17.978210 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c0382-966c-4d6a-916c-c591ebb5d804 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:17.978629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c0382-966c-4d6a-916c-c591ebb5d804 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:17.978830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c0382-966c-4d6a-916c-c591ebb5d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.002690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2b9c0382-966c-4d6a-916c-c591ebb5d804 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:18.003942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2b9c0382-966c-4d6a-916c-c591ebb5d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:18.017142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 184/381] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:18.056068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0482-1e6b-4da6-8228-4ae1dfe06702 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.067176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60d9b-aa64-4d9c-b1da-f39a78ba970f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.067482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60d9b-aa64-4d9c-b1da-f39a78ba970f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.067763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60d9b-aa64-4d9c-b1da-f39a78ba970f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.069716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 185/382] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:18.075501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0482-1e6b-4da6-8228-4ae1dfe06702 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.077435 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5db46-3d8c-4f1f-9952-001135f12826 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.077719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5db46-3d8c-4f1f-9952-001135f12826 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.077999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5db46-3d8c-4f1f-9952-001135f12826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.084972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.085772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.086051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.086326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.108925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:18.117549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:18.126301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 198/383] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:18.127222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-dcd5db46-3d8c-4f1f-9952-001135f12826 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:18.128503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-dcd5db46-3d8c-4f1f-9952-001135f12826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:18.136847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 186/384] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:18.138835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.148691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5061-4566-4ea0-9f25-bbf84b62c926 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.158968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.159660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.159943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.160220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.160989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:18.161295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.162897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.172548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 199/385] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:18.178479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5db46-3d8c-4f1f-9952-001135f12826 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.192342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5db46-3d8c-4f1f-9952-001135f12826 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.195935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.206195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.207052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.207331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.207630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.209032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.212339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb2479-7ab4-4fa7-b636-a8e9cabf5520 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.213707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.215549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 187/386] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:18.221970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.228864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.230207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.230483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.230754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.243636 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55290b2c-7768-46e1-a7e9-f27c4ccf02b6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.253978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:18.260909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:18.263290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.264168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.264444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.264718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.265940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.268040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.269728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 188/387] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:18.270787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 200/388] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:18.275711 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.277574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.293766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a15164-6fa8-471f-a17d-ed8beaaa4c70 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.295932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ef03d-3639-4b16-a983-f336871e8e8b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.298553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.299318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.299728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.300106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.300967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:18.301283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.302883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.305991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9be892-222a-408f-9cba-728e137fa5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.306871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be892-222a-408f-9cba-728e137fa5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.307151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be892-222a-408f-9cba-728e137fa5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.307446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be892-222a-408f-9cba-728e137fa5a3 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.313818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 201/389] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:18.315837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9be892-222a-408f-9cba-728e137fa5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630217dacb45427f8c81275638cd7197, group_id=925e491fd12c4e41ba0dc04bf63bc483, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.318509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9be892-222a-408f-9cba-728e137fa5a3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.319964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.330625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfbfc6-8e7c-4904-a98e-dcb046248435 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.335573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 189/390] 10.222.0.60 () {58 vars in 1463 bytes} [Mon Feb 7 20:23:18 2022] PUT /identity/v3/projects/630217dacb45427f8c81275638cd7197/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:18.336813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fee31-9117-4963-bfc2-038429749a6d None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.337093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fee31-9117-4963-bfc2-038429749a6d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.337368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fee31-9117-4963-bfc2-038429749a6d None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.343344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 190/391] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:18.349006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de8ef-7f2e-4894-95c9-216975ffa501 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.349306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de8ef-7f2e-4894-95c9-216975ffa501 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.349562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de8ef-7f2e-4894-95c9-216975ffa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.390431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ee7de8ef-7f2e-4894-95c9-216975ffa501 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:18.391858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ee7de8ef-7f2e-4894-95c9-216975ffa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:18.415284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.419306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.420765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.422125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.426260 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.431038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.442802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 202/392] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:18.468977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.480862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb83bf0-c66d-4de0-9669-a5fbc70c901f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.487617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.488918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.489402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.489875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.491970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.494912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.503216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 203/393] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:18.505207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.529971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d3f5-5b83-41f5-befe-f74b3ff4c24d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.533089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 191/394] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:18.545501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.546417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.546703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.546985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.552765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272bf5eaae46468b983a59aae152c09c, group_id=925e491fd12c4e41ba0dc04bf63bc483, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.555415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.563041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7de8ef-7f2e-4894-95c9-216975ffa501 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.575976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7de8ef-7f2e-4894-95c9-216975ffa501 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.583235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 204/395] 10.222.0.60 () {58 vars in 1463 bytes} [Mon Feb 7 20:23:18 2022] PUT /identity/v3/projects/272bf5eaae46468b983a59aae152c09c/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:18.656851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.657938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.658370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.658792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.673369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:18.681468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:18.683188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 192/396] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:18.689851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.708914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4419e-bd30-46de-8a97-7daa5eced5d1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.718905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae2fb6-48c1-422f-92de-70150eac6637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.719787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2fb6-48c1-422f-92de-70150eac6637 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.720177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2fb6-48c1-422f-92de-70150eac6637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.720563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2fb6-48c1-422f-92de-70150eac6637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.721522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae2fb6-48c1-422f-92de-70150eac6637 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:18.721935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae2fb6-48c1-422f-92de-70150eac6637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.723680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae2fb6-48c1-422f-92de-70150eac6637 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.736471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 205/397] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:18.742189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.757017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99b9e-ba90-4ba4-b939-1d099eb2feaa admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.764643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.765844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.766274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.766511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1982-e120-421b-966f-8c1596bd9f34 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.766806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1982-e120-421b-966f-8c1596bd9f34 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.766991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.767103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1982-e120-421b-966f-8c1596bd9f34 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.768562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.769168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 206/398] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:18.771074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.778176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f819-51f9-4189-a571-6315f76b5bc7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.778176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f819-51f9-4189-a571-6315f76b5bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.778176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f819-51f9-4189-a571-6315f76b5bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.778622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 193/399] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:18.780207 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.801095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d67869-9d5d-4415-943c-214773451c45 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.810866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.812126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.812596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.813418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.815851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.816199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cb92f819-51f9-4189-a571-6315f76b5bc7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:18.818350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cb92f819-51f9-4189-a571-6315f76b5bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:18.821008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.830093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 194/400] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:18.835364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 207/401] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:18.837230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.853747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72838a6f-99d8-4479-a1fd-f819ad033b30 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.859218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f819-51f9-4189-a571-6315f76b5bc7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:18.860833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.861723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.862006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.862285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.864571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=630217dacb45427f8c81275638cd7197, group_id=925e491fd12c4e41ba0dc04bf63bc483, role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:18.867203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:18.879315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f819-51f9-4189-a571-6315f76b5bc7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:18.895178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 195/402] 10.222.0.60 () {58 vars in 1463 bytes} [Mon Feb 7 20:23:18 2022] PUT /identity/v3/projects/630217dacb45427f8c81275638cd7197/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/a72109d329f74a0b9917f5b6b41a425d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:23:18.895501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:18.896259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:18.896543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:18.896825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:18.917804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:18.926062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:18.928126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 208/403] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:18.933791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:19.003299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6ed74-6a16-4a92-a37f-12964e0fe40a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:19.008763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:19.009671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:19.010147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:19.011571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:19.012557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:19.013053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:19.015039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:19.027136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 196/404] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:19.032461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:19.044967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5635a9d-c5bc-4d98-af11-ae2acac08e51 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:19.059217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:19.060182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:19.060464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:19.060739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:19.068379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:19.070324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:19.072429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 209/405] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:19 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:19.078188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:19.089758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae929708-db3f-4268-b622-91f9d6e98c02 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:19.099245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698d55b-5534-4f95-b34e-a2df97f1003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:19.100452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698d55b-5534-4f95-b34e-a2df97f1003d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:19.100928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698d55b-5534-4f95-b34e-a2df97f1003d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:19.101428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698d55b-5534-4f95-b34e-a2df97f1003d admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:19.102945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698d55b-5534-4f95-b34e-a2df97f1003d admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:19.105400 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698d55b-5534-4f95-b34e-a2df97f1003d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:19.107338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 197/406] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:19 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:19.112953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:19.128055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233c040-cc9e-4700-9893-40be6e33b08c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:19.141282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231f4bc-6a4e-42da-b9ea-18ef628dbc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:19.142178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231f4bc-6a4e-42da-b9ea-18ef628dbc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:19.142462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231f4bc-6a4e-42da-b9ea-18ef628dbc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:19.142737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231f4bc-6a4e-42da-b9ea-18ef628dbc2f admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:19.149606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231f4bc-6a4e-42da-b9ea-18ef628dbc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=272bf5eaae46468b983a59aae152c09c, group_id=925e491fd12c4e41ba0dc04bf63bc483, role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:19.152889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231f4bc-6a4e-42da-b9ea-18ef628dbc2f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:19.169343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 210/407] 10.222.0.60 () {58 vars in 1463 bytes} [Mon Feb 7 20:23:19 2022] PUT /identity/v3/projects/272bf5eaae46468b983a59aae152c09c/groups/925e491fd12c4e41ba0dc04bf63bc483/roles/a72109d329f74a0b9917f5b6b41a425d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:20.096419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f85fe-1287-4a45-b0fa-31aee4ddfa5a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:20.096926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f85fe-1287-4a45-b0fa-31aee4ddfa5a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:20.097028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f85fe-1287-4a45-b0fa-31aee4ddfa5a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:20.098986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 198/408] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:20.104192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acfc9b-da62-4c08-bb50-e1b3a30c7cf8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:20.105224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acfc9b-da62-4c08-bb50-e1b3a30c7cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:20.105296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acfc9b-da62-4c08-bb50-e1b3a30c7cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:20.128443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-38acfc9b-da62-4c08-bb50-e1b3a30c7cf8 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:20.129554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-38acfc9b-da62-4c08-bb50-e1b3a30c7cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:20.203728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 211/409] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:20.231765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f85fe-1287-4a45-b0fa-31aee4ddfa5a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:20.246703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f85fe-1287-4a45-b0fa-31aee4ddfa5a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:20.251616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:20.252651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:20.253143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:20.253610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:20.266103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:20.273505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:20.275266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 199/410] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:20.281909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acfc9b-da62-4c08-bb50-e1b3a30c7cf8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:20.296938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acfc9b-da62-4c08-bb50-e1b3a30c7cf8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:20.306984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:20.307712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:20.307992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:20.311899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:20.312696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:20.313004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:20.314594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:20.323789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 212/411] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:20.329277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:20.345326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ad1f3-b4d9-4b7b-a1b6-744a8fad1349 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:20.350064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:20.351281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:20.351773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:20.352239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] PATH_INFO: `/v3/groups/dc37c95ad11c4583b3b1e6aa189afcce` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:20.353611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] RBAC: Authorizing `identity:get_group(group_id=dc37c95ad11c4583b3b1e6aa189afcce)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:20.356448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:20.358531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 200/412] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:20 2022] GET /identity/v3/groups/dc37c95ad11c4583b3b1e6aa189afcce => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:20.364366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:20.379932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b1fb5-53ef-47e1-88cb-c1a51176941b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:20.391034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0d68d-6479-4e99-95d9-6d7187a31ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:20.391931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0d68d-6479-4e99-95d9-6d7187a31ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:20.392210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0d68d-6479-4e99-95d9-6d7187a31ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:20.392487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0d68d-6479-4e99-95d9-6d7187a31ae5 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:20.396166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0d68d-6479-4e99-95d9-6d7187a31ae5 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:20.397972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0d68d-6479-4e99-95d9-6d7187a31ae5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:20.399973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 213/413] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:20 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:20.406641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:20.417139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fcf39-6905-481a-b567-480c77d81725 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:20.425041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d86092-e364-4baf-b70f-5cd4da998397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:20.426187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d86092-e364-4baf-b70f-5cd4da998397 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:20.426694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d86092-e364-4baf-b70f-5cd4da998397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:20.427186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d86092-e364-4baf-b70f-5cd4da998397 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b/groups/dc37c95ad11c4583b3b1e6aa189afcce/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:20.429498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d86092-e364-4baf-b70f-5cd4da998397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd85593742943409724ee224daef15b, group_id=dc37c95ad11c4583b3b1e6aa189afcce, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:20.432546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d86092-e364-4baf-b70f-5cd4da998397 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:20.452435 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 201/414] 10.222.0.60 () {58 vars in 1463 bytes} [Mon Feb 7 20:23:20 2022] PUT /identity/v3/projects/1fd85593742943409724ee224daef15b/groups/dc37c95ad11c4583b3b1e6aa189afcce/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:21.295887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3413d-401f-45e0-9545-b2a7a60f0acb None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.296915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3413d-401f-45e0-9545-b2a7a60f0acb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.297405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3413d-401f-45e0-9545-b2a7a60f0acb None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.299719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 214/415] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:21.304879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e16f71-dc02-4f4e-9c07-2fc236b3ef04 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.305729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e16f71-dc02-4f4e-9c07-2fc236b3ef04 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.306219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e16f71-dc02-4f4e-9c07-2fc236b3ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.329625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-50e16f71-dc02-4f4e-9c07-2fc236b3ef04 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:21.331133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-50e16f71-dc02-4f4e-9c07-2fc236b3ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:21.396844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d6f5-46a7-4e10-9708-ac03d88c5f73 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.397193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d6f5-46a7-4e10-9708-ac03d88c5f73 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.397402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d6f5-46a7-4e10-9708-ac03d88c5f73 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.399239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 215/417] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:21.399468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 202/417] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:21.404474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada51d49-d132-4d36-8385-e505dd4f0130 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.404766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada51d49-d132-4d36-8385-e505dd4f0130 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.405046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada51d49-d132-4d36-8385-e505dd4f0130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.425736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ada51d49-d132-4d36-8385-e505dd4f0130 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:21.426913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ada51d49-d132-4d36-8385-e505dd4f0130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:21.435460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 216/418] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:21.438699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e16f71-dc02-4f4e-9c07-2fc236b3ef04 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.449585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e16f71-dc02-4f4e-9c07-2fc236b3ef04 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.456962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.458098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.458639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.459141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.460748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada51d49-d132-4d36-8385-e505dd4f0130 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.470138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada51d49-d132-4d36-8385-e505dd4f0130 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.479778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:21.480412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.481212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.481489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.481764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.501173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:21.503047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:21.505355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 203/419] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:21.510364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.516620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 20:23:21.523014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 217/420] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:21.527059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe774b-997d-41cb-a40b-137f093d25eb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.528885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.542300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1ba5-6931-49d9-b0bd-23bcf0b024d7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.543728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.544535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.544822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.545099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.545875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:21.546233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.547881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.559891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.560615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.560896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.561228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.562005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:21.562364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.564259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.566479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 204/421] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:21.572108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.591850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138595c1-8c90-48f9-ae42-58ec2fbfcccd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.592526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 218/422] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:21.594724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.605002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.605707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.606031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.606312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.614616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48345-54e4-4207-9003-e43c61fbf2d3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.621441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.624172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.625560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.626267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.626548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.626827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.641325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.643337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.648877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 205/423] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:21.655260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.661076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 219/424] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:21.669182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e65f4-ddb3-4a06-ac8c-1bf0eb723cee admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.673763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.674606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.674886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.675159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.676740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.684276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.685912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497dbc6-4a81-4f64-99d8-7a3c9fb8ca92 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.686344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.688393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 206/425] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:21.690769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.691710 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.691990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.692316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.693592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.695364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.695918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.697904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 220/426] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:21.708125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.711317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d1a45-7fd4-4563-8a46-c6a18ba1815b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.719577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43b1ea-a7a7-4b24-b345-90324bc19c50 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.724485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.725404 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.725582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.725755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.725947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.726405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.726686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.726965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.727280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.729381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.732028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 221/427] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:21.732311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.734253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.737213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 207/428] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:21.742023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.742202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:21.753805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696745ee-97bd-4957-b514-2b6441aea4b2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.756919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4bd7e-c3d4-47d2-8cdf-5c2c8bc7ff70 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:21.759380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e068-5213-456b-b201-698c04598d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.760326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e068-5213-456b-b201-698c04598d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.760863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e068-5213-456b-b201-698c04598d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.761373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e068-5213-456b-b201-698c04598d66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.762457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e068-5213-456b-b201-698c04598d66 admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=272bf5eaae46468b983a59aae152c09c) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:21.762943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e068-5213-456b-b201-698c04598d66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.765171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e068-5213-456b-b201-698c04598d66 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.774501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 222/429] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:21.776764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f8d0e-d9fb-4ef5-8c50-be97869942b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:21.777769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8d0e-d9fb-4ef5-8c50-be97869942b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:21.778226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8d0e-d9fb-4ef5-8c50-be97869942b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:21.778672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8d0e-d9fb-4ef5-8c50-be97869942b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:21.779960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f8d0e-d9fb-4ef5-8c50-be97869942b5 admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=6d0818e098ae461b8c0b30d4061e0f68, scope.project.id=630217dacb45427f8c81275638cd7197) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:21.780451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f8d0e-d9fb-4ef5-8c50-be97869942b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:21.782942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f8d0e-d9fb-4ef5-8c50-be97869942b5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:21.790593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 208/430] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:21 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=6d0818e098ae461b8c0b30d4061e0f68 => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:22.055875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be840-2198-4441-8df9-5dfc0c199359 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.056579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be840-2198-4441-8df9-5dfc0c199359 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.057061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be840-2198-4441-8df9-5dfc0c199359 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.059461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 223/431] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:22.064820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef771de-8b5c-4ecd-9826-4cfc1c7af01a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.065373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef771de-8b5c-4ecd-9826-4cfc1c7af01a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.065865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef771de-8b5c-4ecd-9826-4cfc1c7af01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.087895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7ef771de-8b5c-4ecd-9826-4cfc1c7af01a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:22.090036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7ef771de-8b5c-4ecd-9826-4cfc1c7af01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:22.100597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 209/432] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:22.127822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be840-2198-4441-8df9-5dfc0c199359 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.144712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be840-2198-4441-8df9-5dfc0c199359 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.152542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.153347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.153632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.153907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.169374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:22.176615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:22.178049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 224/433] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:22.183719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef771de-8b5c-4ecd-9826-4cfc1c7af01a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.193088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef771de-8b5c-4ecd-9826-4cfc1c7af01a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.199661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.200331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.200614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.200893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.201660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:22.201966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.203607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.214010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 210/434] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:22.219331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.230477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85860cf0-489f-4e67-9b68-d60eeee04924 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.236257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.236897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.237178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.237455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.246256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.248072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.257583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 225/435] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:22.263951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.274409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410af34-5d7b-4a3e-a0d8-ed71fdc40f93 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.279914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.281067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.281845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.282338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.283836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.286170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.288453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 211/436] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:22.294172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.303755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e573-6796-4648-b831-a17e2d67e64c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.308994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3403f-eb2a-40aa-acab-ce58b3ee0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.310090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3403f-eb2a-40aa-acab-ce58b3ee0994 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.310588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3403f-eb2a-40aa-acab-ce58b3ee0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.311072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3403f-eb2a-40aa-acab-ce58b3ee0994 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.312500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3403f-eb2a-40aa-acab-ce58b3ee0994 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.314704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3403f-eb2a-40aa-acab-ce58b3ee0994 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.316840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 226/437] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:22.322583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.333769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd6880-e356-44a9-b756-ee4b2cd66201 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.338183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47588053-cd8e-41ac-a1e4-28660aadbfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.339431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47588053-cd8e-41ac-a1e4-28660aadbfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.339706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47588053-cd8e-41ac-a1e4-28660aadbfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.339982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47588053-cd8e-41ac-a1e4-28660aadbfe1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.340828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47588053-cd8e-41ac-a1e4-28660aadbfe1 admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=630217dacb45427f8c81275638cd7197) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:22.341137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47588053-cd8e-41ac-a1e4-28660aadbfe1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.342979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47588053-cd8e-41ac-a1e4-28660aadbfe1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.349344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 212/438] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=630217dacb45427f8c81275638cd7197&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:22.403032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a60cb-766b-427b-b758-f5f7fca5ece2 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.403353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a60cb-766b-427b-b758-f5f7fca5ece2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.403637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a60cb-766b-427b-b758-f5f7fca5ece2 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.405662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 227/439] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:22.411882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0897-6f2a-4b78-b8d1-5f812f854970 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.412189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0897-6f2a-4b78-b8d1-5f812f854970 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.412448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0897-6f2a-4b78-b8d1-5f812f854970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.433593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-803a0897-6f2a-4b78-b8d1-5f812f854970 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:22.434799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-803a0897-6f2a-4b78-b8d1-5f812f854970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:22.444476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 213/440] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:22.467790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a60cb-766b-427b-b758-f5f7fca5ece2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.485108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a60cb-766b-427b-b758-f5f7fca5ece2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.490034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.490903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.491179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.491494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.503783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:22.511162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:22.517462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 228/441] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:22.518973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a0897-6f2a-4b78-b8d1-5f812f854970 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.528807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a0897-6f2a-4b78-b8d1-5f812f854970 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.533631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.534296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.534571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.534845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.535690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:22.536050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.537712 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.547426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 214/442] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:22.552894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.563746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e1f8c-7827-4438-a4bc-a76a797f517e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.568219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.568922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.569204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.569479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.579565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.581317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.591487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 229/443] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:22.596232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.606458 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3398-6806-48c3-bbff-8932cd6889a5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.611421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.612505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.612936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.613276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] PATH_INFO: `/v3/projects/272bf5eaae46468b983a59aae152c09c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.614538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] RBAC: Authorizing `identity:get_project(project_id=272bf5eaae46468b983a59aae152c09c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.616740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.618718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 215/444] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/projects/272bf5eaae46468b983a59aae152c09c => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:22.624552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.634109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5cf4f-886f-4105-b21c-0f577585ad30 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.639097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacec52-e337-47cb-a273-468abfe568b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.640021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacec52-e337-47cb-a273-468abfe568b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.640327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacec52-e337-47cb-a273-468abfe568b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.640606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacec52-e337-47cb-a273-468abfe568b8 admin admin] PATH_INFO: `/v3/groups/925e491fd12c4e41ba0dc04bf63bc483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.641787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacec52-e337-47cb-a273-468abfe568b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=925e491fd12c4e41ba0dc04bf63bc483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.643746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacec52-e337-47cb-a273-468abfe568b8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.645609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 230/445] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/groups/925e491fd12c4e41ba0dc04bf63bc483 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:22.651547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:22.664511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769235-f043-4b44-a246-43fc68ad9866 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:22.668986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1284d30-6147-4ab8-b909-cf9eb0760181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:22.669704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284d30-6147-4ab8-b909-cf9eb0760181 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:22.669992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284d30-6147-4ab8-b909-cf9eb0760181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:22.670271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1284d30-6147-4ab8-b909-cf9eb0760181 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:22.671112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1284d30-6147-4ab8-b909-cf9eb0760181 admin admin] RBAC: Adding query filter params (group.id=925e491fd12c4e41ba0dc04bf63bc483, role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=272bf5eaae46468b983a59aae152c09c) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:22.671452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1284d30-6147-4ab8-b909-cf9eb0760181 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:22.673299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1284d30-6147-4ab8-b909-cf9eb0760181 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:22.680633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 216/446] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:22 2022] GET /identity/v3/role_assignments?group.id=925e491fd12c4e41ba0dc04bf63bc483&scope.project.id=272bf5eaae46468b983a59aae152c09c&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:23.145052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05833078-a0f7-41dd-9b6f-4d477fefcada None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.145417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05833078-a0f7-41dd-9b6f-4d477fefcada None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.145697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05833078-a0f7-41dd-9b6f-4d477fefcada None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.147475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 231/447] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:23.153433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6664-ee3f-4a7f-8eb8-f3bfc3d85c6c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.153721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6664-ee3f-4a7f-8eb8-f3bfc3d85c6c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.154003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6664-ee3f-4a7f-8eb8-f3bfc3d85c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.172187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-250b6664-ee3f-4a7f-8eb8-f3bfc3d85c6c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:23.173356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-250b6664-ee3f-4a7f-8eb8-f3bfc3d85c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:23.180758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 217/448] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:23.205627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05833078-a0f7-41dd-9b6f-4d477fefcada None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:23.218067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05833078-a0f7-41dd-9b6f-4d477fefcada None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:23.223321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:23.224115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.224395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.224695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.234720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:23.241454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:23.242592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 232/449] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:23.248691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b6664-ee3f-4a7f-8eb8-f3bfc3d85c6c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:23.257471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b6664-ee3f-4a7f-8eb8-f3bfc3d85c6c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:23.262354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:23.263006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.263288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.263603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.264362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:23.264689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:23.266292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:23.274131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 218/450] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:23.279089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:23.288513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95612a2e-a662-493d-a3b4-05214e6160da admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:23.292773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:23.293378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.293660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.293936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.301910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:23.303677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:23.312831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 233/451] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:23.317856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:23.327579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaa495-46bd-430c-8088-0449ac976203 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:23.331814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:23.332615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.332897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.333172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.334337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:23.336117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:23.337677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 219/452] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:23:23 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:23.342371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:23.350522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e93f-9b66-45b6-887f-5b9a3ab26860 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:23.354754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101e92f-3bd4-4a86-8741-a6e222e2f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:23.355581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101e92f-3bd4-4a86-8741-a6e222e2f384 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.355864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101e92f-3bd4-4a86-8741-a6e222e2f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.356137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101e92f-3bd4-4a86-8741-a6e222e2f384 admin admin] PATH_INFO: `/v3/groups/dc37c95ad11c4583b3b1e6aa189afcce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.357297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101e92f-3bd4-4a86-8741-a6e222e2f384 admin admin] RBAC: Authorizing `identity:get_group(group_id=dc37c95ad11c4583b3b1e6aa189afcce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:23.359124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101e92f-3bd4-4a86-8741-a6e222e2f384 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:23.360664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 234/453] 10.222.0.60 () {56 vars in 1201 bytes} [Mon Feb 7 20:23:23 2022] GET /identity/v3/groups/dc37c95ad11c4583b3b1e6aa189afcce => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:23.365548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:23.375229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4186-630d-485d-9966-092eeaaa33f0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:23.379590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43e970-6894-4f90-82db-e90100f82c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:23.380188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e970-6894-4f90-82db-e90100f82c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:23.380472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e970-6894-4f90-82db-e90100f82c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:23.380749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43e970-6894-4f90-82db-e90100f82c85 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:23.381567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e970-6894-4f90-82db-e90100f82c85 admin admin] RBAC: Adding query filter params (group.id=dc37c95ad11c4583b3b1e6aa189afcce, role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=1fd85593742943409724ee224daef15b) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:23.381877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e970-6894-4f90-82db-e90100f82c85 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:23.383701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43e970-6894-4f90-82db-e90100f82c85 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:23.389841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 220/454] 10.222.0.60 () {56 vars in 1397 bytes} [Mon Feb 7 20:23:23 2022] GET /identity/v3/role_assignments?group.id=dc37c95ad11c4583b3b1e6aa189afcce&scope.project.id=1fd85593742943409724ee224daef15b&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:26.157693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95280b76-a4b7-44d6-b8ae-fbf2c1cea4f7 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.158212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95280b76-a4b7-44d6-b8ae-fbf2c1cea4f7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.158212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95280b76-a4b7-44d6-b8ae-fbf2c1cea4f7 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.160244 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 235/455] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:26.165750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ac70-2c41-4614-a1c9-f9f03ce391eb None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.166621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ac70-2c41-4614-a1c9-f9f03ce391eb None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.167106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ac70-2c41-4614-a1c9-f9f03ce391eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.196401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-14b1ac70-2c41-4614-a1c9-f9f03ce391eb None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:26.198647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-14b1ac70-2c41-4614-a1c9-f9f03ce391eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:26.207568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 221/456] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:26.244378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95280b76-a4b7-44d6-b8ae-fbf2c1cea4f7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.260313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95280b76-a4b7-44d6-b8ae-fbf2c1cea4f7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.265778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8833b-a27b-4b17-be42-324d3eadc2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.266795 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8833b-a27b-4b17-be42-324d3eadc2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.267275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8833b-a27b-4b17-be42-324d3eadc2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.267770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8833b-a27b-4b17-be42-324d3eadc2d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.283165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8833b-a27b-4b17-be42-324d3eadc2d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.285368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8833b-a27b-4b17-be42-324d3eadc2d2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.315137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9bf8833b-a27b-4b17-be42-324d3eadc2d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:26.316795 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 236/457] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:26.323845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ac70-2c41-4614-a1c9-f9f03ce391eb None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.339656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9077-c4bc-4e14-a572-47549b735d6a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.340287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9077-c4bc-4e14-a572-47549b735d6a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.340767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9077-c4bc-4e14-a572-47549b735d6a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.342733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 237/458] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:26.345413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ac70-2c41-4614-a1c9-f9f03ce391eb None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.353408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928be3-a680-44b7-9389-7b986066f940 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.353993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928be3-a680-44b7-9389-7b986066f940 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.354513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928be3-a680-44b7-9389-7b986066f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.358708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d106b-29ed-423e-a199-2f57cc1fdf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.360701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d106b-29ed-423e-a199-2f57cc1fdf04 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.362576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d106b-29ed-423e-a199-2f57cc1fdf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.363077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d106b-29ed-423e-a199-2f57cc1fdf04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.364056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d106b-29ed-423e-a199-2f57cc1fdf04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:26.364565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d106b-29ed-423e-a199-2f57cc1fdf04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.370385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d106b-29ed-423e-a199-2f57cc1fdf04 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.383012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c2928be3-a680-44b7-9389-7b986066f940 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:26.383792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 222/459] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:26.384814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b02bba-22d1-474a-80e4-6f4f95902423 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.385103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b02bba-22d1-474a-80e4-6f4f95902423 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.385486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b02bba-22d1-474a-80e4-6f4f95902423 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.386481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c2928be3-a680-44b7-9389-7b986066f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:26.391438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 223/460] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:26.391629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b02bba-22d1-474a-80e4-6f4f95902423 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.399459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 238/461] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 07 20:23:26.400851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5c5d3-fd82-40d5-a44c-aa9e51162a98 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.401148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5c5d3-fd82-40d5-a44c-aa9e51162a98 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.401398 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5c5d3-fd82-40d5-a44c-aa9e51162a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.406718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b02bba-22d1-474a-80e4-6f4f95902423 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.411103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.411731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.412014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.412386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.413265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.415472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.436571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-31f5c5d3-fd82-40d5-a44c-aa9e51162a98 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:26.437525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 224/462] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/users => generated 248 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:26.438354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.438670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-31f5c5d3-fd82-40d5-a44c-aa9e51162a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:26.447479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 239/463] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:26.450338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b01632-eb49-49f7-9cd7-2b97b2cef888 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.460161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.460990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.461275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.461555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.480137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.488526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.507837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:26.509236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 225/464] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:26.509629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5c5d3-fd82-40d5-a44c-aa9e51162a98 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.514863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.525458 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8481-5f9b-4597-8934-4b734a1d3300 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.531039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.533185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.533185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.533185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.533574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:26.533891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.534080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5c5d3-fd82-40d5-a44c-aa9e51162a98 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.539452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.550920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d9df1-37f9-4732-b434-95cd861896ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.551116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 226/465] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:26.552159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d9df1-37f9-4732-b434-95cd861896ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.552442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d9df1-37f9-4732-b434-95cd861896ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.552715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d9df1-37f9-4732-b434-95cd861896ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.559857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.578902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d9df1-37f9-4732-b434-95cd861896ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.581115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dee07-dde4-4c98-98fe-a5af00707a3d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.583852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d9df1-37f9-4732-b434-95cd861896ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.596664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb24c8-3ffb-4afc-9d20-a1f4012d3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.597358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb24c8-3ffb-4afc-9d20-a1f4012d3d24 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.597642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb24c8-3ffb-4afc-9d20-a1f4012d3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.597924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb24c8-3ffb-4afc-9d20-a1f4012d3d24 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.598673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb24c8-3ffb-4afc-9d20-a1f4012d3d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.600815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb24c8-3ffb-4afc-9d20-a1f4012d3d24 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.619052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-157d9df1-37f9-4732-b434-95cd861896ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:26.620739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 240/466] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:26.626681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d35e-79a4-48e2-b884-2971a8cccc8e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.627046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d35e-79a4-48e2-b884-2971a8cccc8e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.627234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d35e-79a4-48e2-b884-2971a8cccc8e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.629245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 241/467] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:26.632373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d35e-79a4-48e2-b884-2971a8cccc8e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.641253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 227/468] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/users => generated 246 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:26.642718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8d731-ad0d-4412-badb-4510a7439109 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.643009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8d731-ad0d-4412-badb-4510a7439109 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.643384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8d731-ad0d-4412-badb-4510a7439109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.652954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d35e-79a4-48e2-b884-2971a8cccc8e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.659723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.660765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.661579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.662996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.664072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:26.664735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.666021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:26.666021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:26.666021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:26.667301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.674967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c7e8d731-ad0d-4412-badb-4510a7439109 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:26.676239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c7e8d731-ad0d-4412-badb-4510a7439109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:26.687292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 228/469] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:26.689622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 242/470] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:26.695296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8d731-ad0d-4412-badb-4510a7439109 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.706195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8d731-ad0d-4412-badb-4510a7439109 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.711164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.712425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.714016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.714341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.714916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.715958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.718277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.731205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b04e2d-1df2-45fc-80e1-5560f4b66155 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.742305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.742726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.742974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.743237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.756698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 229/471] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/users => generated 248 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:26.760603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.762851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.783889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:26.789697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 243/472] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:26.792707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.804168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1d991-6416-4d72-bccf-0e6e318c90f0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.809197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd6598-fca7-4b2d-862d-cb8e423ddf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.809890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd6598-fca7-4b2d-862d-cb8e423ddf1c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.810174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd6598-fca7-4b2d-862d-cb8e423ddf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.810506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd6598-fca7-4b2d-862d-cb8e423ddf1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.811268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd6598-fca7-4b2d-862d-cb8e423ddf1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:26.811613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd6598-fca7-4b2d-862d-cb8e423ddf1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.813350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd6598-fca7-4b2d-862d-cb8e423ddf1c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.832277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 230/473] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:26.834814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:26.846554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202d67-b19c-4faa-a9ba-82356506261a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:26.851446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82052a93-4050-4afa-8cb4-c2fc66013c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:26.852152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82052a93-4050-4afa-8cb4-c2fc66013c78 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:26.852442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82052a93-4050-4afa-8cb4-c2fc66013c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:26.852781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82052a93-4050-4afa-8cb4-c2fc66013c78 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:26.853556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82052a93-4050-4afa-8cb4-c2fc66013c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:26.855707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82052a93-4050-4afa-8cb4-c2fc66013c78 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:26.880971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 244/474] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:26 2022] POST /identity/v3/users => generated 249 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:27.845924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4a786-b998-412a-8118-86d2d9ace40f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:27.846435 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4a786-b998-412a-8118-86d2d9ace40f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:27.846508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4a786-b998-412a-8118-86d2d9ace40f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:27.854310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 231/475] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:27.858718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc700-d2ec-471e-b286-4dfe7533898b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:27.859218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc700-d2ec-471e-b286-4dfe7533898b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:27.859423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc700-d2ec-471e-b286-4dfe7533898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:27.889619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4d2dc700-d2ec-471e-b286-4dfe7533898b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:27.890835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4d2dc700-d2ec-471e-b286-4dfe7533898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:27.901965 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 245/476] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:27.944090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4a786-b998-412a-8118-86d2d9ace40f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:27.961549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4a786-b998-412a-8118-86d2d9ace40f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:27.968210 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:27.968914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:27.969199 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:27.969475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:27.970265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:27.971946 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:27.984405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.sql.core [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 07 20:23:27.984405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 07 20:23:27.984405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [parameters: {'id': '5bb99c3059864fe2904311976a997e0e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 07 20:23:27.984405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79178) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 07 20:23:27.998862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 07 20:23:28.000590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 232/477] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:23:27 2022] POST /identity/v3/roles => generated 144 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:28.006369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc700-d2ec-471e-b286-4dfe7533898b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:28.015946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc700-d2ec-471e-b286-4dfe7533898b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:28.029435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abdc5-db9f-49d0-b2ad-16cba4bc4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:28.030255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abdc5-db9f-49d0-b2ad-16cba4bc4d50 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:28.030532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abdc5-db9f-49d0-b2ad-16cba4bc4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:28.030802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abdc5-db9f-49d0-b2ad-16cba4bc4d50 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:28.044786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abdc5-db9f-49d0-b2ad-16cba4bc4d50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:28.051969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-0e4abdc5-db9f-49d0-b2ad-16cba4bc4d50 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 20:23:28.053699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 246/478] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:28.061254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:28.076421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f7143-dc80-4df6-af59-d374bbe50fcc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:28.088199 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79369c-1145-4c95-b86a-d4bdd11ae389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:28.088785 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79369c-1145-4c95-b86a-d4bdd11ae389 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:28.089073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79369c-1145-4c95-b86a-d4bdd11ae389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:28.089354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79369c-1145-4c95-b86a-d4bdd11ae389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:28.090129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79369c-1145-4c95-b86a-d4bdd11ae389 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:28.090437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79369c-1145-4c95-b86a-d4bdd11ae389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:28.092096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79369c-1145-4c95-b86a-d4bdd11ae389 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:28.107614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 233/479] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:29.172152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ef36d-23a7-496b-aec9-7142d8a0c11c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.172841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ef36d-23a7-496b-aec9-7142d8a0c11c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.172841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ef36d-23a7-496b-aec9-7142d8a0c11c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.174745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 247/480] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:29.180122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4a976-f562-4069-bcf4-2601c8141fd1 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.180630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4a976-f562-4069-bcf4-2601c8141fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.180781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4a976-f562-4069-bcf4-2601c8141fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.204999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-34e4a976-f562-4069-bcf4-2601c8141fd1 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:29.206190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-34e4a976-f562-4069-bcf4-2601c8141fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:29.219302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 234/481] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:29.266377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ef36d-23a7-496b-aec9-7142d8a0c11c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.281585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ef36d-23a7-496b-aec9-7142d8a0c11c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.286101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154c6f0-2857-4d13-9ade-f1399ab2d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.286893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c6f0-2857-4d13-9ade-f1399ab2d1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.287175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c6f0-2857-4d13-9ade-f1399ab2d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.287473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c6f0-2857-4d13-9ade-f1399ab2d1cb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.308373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c6f0-2857-4d13-9ade-f1399ab2d1cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:29.315248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e154c6f0-2857-4d13-9ade-f1399ab2d1cb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:29.316660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 248/482] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:29.322417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4a976-f562-4069-bcf4-2601c8141fd1 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.330743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8fdb-9cd2-457b-b896-81b98687f0f3 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.331027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8fdb-9cd2-457b-b896-81b98687f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.331306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8fdb-9cd2-457b-b896-81b98687f0f3 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.333747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4a976-f562-4069-bcf4-2601c8141fd1 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.336032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 249/483] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:29.340705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.341362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.341645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.341919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.342680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.342987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.344626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.347186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6bf3-94ae-46ff-b892-dde35751120b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.347502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6bf3-94ae-46ff-b892-dde35751120b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.347781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a6bf3-94ae-46ff-b892-dde35751120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.366247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 235/484] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:29.377256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.380646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6d9a6bf3-94ae-46ff-b892-dde35751120b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:29.381972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6d9a6bf3-94ae-46ff-b892-dde35751120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:29.383680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb8db1-bbeb-46a4-8399-2e2fe5b92054 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.392264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.393987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.395517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 250/485] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:29.396068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.396555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.415058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.417849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.424546 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6bf3-94ae-46ff-b892-dde35751120b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.433630 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a6bf3-94ae-46ff-b892-dde35751120b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.444621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:29.445983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 236/486] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:29.452163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.457476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.458284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.458563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.458837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.463422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bfcc8-b0b0-463c-85e8-c71efa3e0c94 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.468584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.469570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.470079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.470556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.471582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.472091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.474012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.481188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:29.488004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 237/487] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:29.496309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:29.498047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 251/488] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:29.499151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.505176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.515370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f28f49-1849-43a2-930c-b93824bc85f3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.521170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe747db-77bf-4967-ab4e-da736799bc9d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.525622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.527425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.528792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.529584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.531558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.533726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.537073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.537593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.538558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.539954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.543413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.547710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.554228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.561069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 252/489] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:29.566807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.579822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 07 20:23:29.585600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84ebd-0d2e-4683-8c11-f3850695325b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.587300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 238/490] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:29.596162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.597283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.597815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.598288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.602025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.613028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805ecac-ead1-489d-9725-b5ece083db4f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.623836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.624822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.625317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.625841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.626933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.627467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.629542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:29.629542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:29.629542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:29.631329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.632355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.636120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.672076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:29.683498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 253/491] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:29.688354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.697003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 239/492] 10.222.0.60 () {56 vars in 1158 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:29.703165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da567d3-14ff-422d-a619-55b0618d8f0d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.703287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.714606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5278e14-4c98-44f6-a3d9-31c1df8ead32 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.719594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.720187 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.720801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.721081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.721360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.721687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.721911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.722372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.722650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.723067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.725063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.731766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.733789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.747637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 240/493] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:29.749096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.750540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 254/494] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:29.755982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.758741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bdff6-32d2-4a78-bb02-e49761bd4c09 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.766763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.767901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.768395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.768913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.769184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce182d8-bab3-4ede-a0f5-8b4e8f26c3a0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.773622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27505465-a6ce-4dcf-9378-e675b15c2b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.774394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505465-a6ce-4dcf-9378-e675b15c2b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.774669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505465-a6ce-4dcf-9378-e675b15c2b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.774944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505465-a6ce-4dcf-9378-e675b15c2b57 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.783132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.783831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505465-a6ce-4dcf-9378-e675b15c2b57 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.785498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.785805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505465-a6ce-4dcf-9378-e675b15c2b57 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.799099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-27505465-a6ce-4dcf-9378-e675b15c2b57 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:23:29.804835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 255/495] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:29.806100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:29.806288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de705616-9f2a-424b-aa83-d6bbdd43608e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.806564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de705616-9f2a-424b-aa83-d6bbdd43608e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.806843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de705616-9f2a-424b-aa83-d6bbdd43608e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.808778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 241/496] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:29.811448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 256/497] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:29.814391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.814845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de705616-9f2a-424b-aa83-d6bbdd43608e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.825957 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5222-a00a-4514-8d5f-c70799ed6538 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.827931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de705616-9f2a-424b-aa83-d6bbdd43608e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.831203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.832111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.832293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e02753-3651-4749-a4e6-a76291c3c418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.832482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.832866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.832968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02753-3651-4749-a4e6-a76291c3c418 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.833197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02753-3651-4749-a4e6-a76291c3c418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.833476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02753-3651-4749-a4e6-a76291c3c418 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.833906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.834210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02753-3651-4749-a4e6-a76291c3c418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.834324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.834516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02753-3651-4749-a4e6-a76291c3c418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.836129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02753-3651-4749-a4e6-a76291c3c418 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.836442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.854450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 257/498] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:29.855902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3addd-2191-4c73-b7fc-48a0a3a25023 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.856190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3addd-2191-4c73-b7fc-48a0a3a25023 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.856470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3addd-2191-4c73-b7fc-48a0a3a25023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.859079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 242/499] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:29.860053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.870383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d9a2-4f01-4e22-a419-a879f3066ca7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.874813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88bc62-0b3f-4143-a814-bfa4b2e699c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.875620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88bc62-0b3f-4143-a814-bfa4b2e699c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.875903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88bc62-0b3f-4143-a814-bfa4b2e699c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.876178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88bc62-0b3f-4143-a814-bfa4b2e699c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.881175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e5b3addd-2191-4c73-b7fc-48a0a3a25023 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:29.882374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e5b3addd-2191-4c73-b7fc-48a0a3a25023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:29.883204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88bc62-0b3f-4143-a814-bfa4b2e699c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.885871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88bc62-0b3f-4143-a814-bfa4b2e699c8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.890818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 258/500] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:29.892397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3addd-2191-4c73-b7fc-48a0a3a25023 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.898705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9b88bc62-0b3f-4143-a814-bfa4b2e699c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:29.900029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 243/501] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:29.904031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3addd-2191-4c73-b7fc-48a0a3a25023 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.905548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013c80d-ce25-4853-aabf-049944a27eeb None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.905819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013c80d-ce25-4853-aabf-049944a27eeb None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.906097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013c80d-ce25-4853-aabf-049944a27eeb None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.912202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 244/502] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:29.912202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013c80d-ce25-4853-aabf-049944a27eeb None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.915781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82167f1-f5af-40e2-b967-70e225f37c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.916454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82167f1-f5af-40e2-b967-70e225f37c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.916744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82167f1-f5af-40e2-b967-70e225f37c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.917020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82167f1-f5af-40e2-b967-70e225f37c09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.925078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82167f1-f5af-40e2-b967-70e225f37c09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.926332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013c80d-ce25-4853-aabf-049944a27eeb None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.926804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82167f1-f5af-40e2-b967-70e225f37c09 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.930638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.931685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.931685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.931864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.933143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:29.933450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:29.934499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:29.934499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:29.934499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:29.935586 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:29.936432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 259/503] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:29.940631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055bef-30dc-4877-b542-594dd5fe0719 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.940917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055bef-30dc-4877-b542-594dd5fe0719 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.941206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b055bef-30dc-4877-b542-594dd5fe0719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.961329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 245/504] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:29.961329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.962147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6b055bef-30dc-4877-b542-594dd5fe0719 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:29.963345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6b055bef-30dc-4877-b542-594dd5fe0719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:29.970140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c2e93-1b61-4aa6-bbd9-d4a327527298 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.971055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 260/505] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:29.971900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055bef-30dc-4877-b542-594dd5fe0719 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:29.983007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.983994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.984460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.984733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.988037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b055bef-30dc-4877-b542-594dd5fe0719 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:29.992613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:29.993552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:29.994002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:29.994443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:29.997414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:30.004949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:30.006018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.006368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 246/506] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.007133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.009631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.017045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ecebd-ee6e-4f05-b0f8-2316d65ddca0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.021504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.022100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.022379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.022660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.023535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=94d4a2ed97744c9fad6b44b5835e260f) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.023849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.025664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.032240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 247/507] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/role_assignments?user.id=94d4a2ed97744c9fad6b44b5835e260f&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.032976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.034144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:30.035642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 261/508] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.036732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.042431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec65e6-811c-40c6-a03d-2f3e593c39d9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.047083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.047924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.048199 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.048477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.051224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf7c1-e3c4-46f5-85f1-44660c314d20 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.058624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.059742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.060234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.061018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.061505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:30.062270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.062821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.064885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.069034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:30.075513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 248/509] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.075513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.082081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 262/510] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.083565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.087526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b32eff-f3a9-4bfb-888c-41d9e35aa96d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.092619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.093659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.093659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.093838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.094566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.094872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.099950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.103762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005abbfa-049d-4089-8c51-40d243c464b5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.118261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.119234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.119580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.119866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.120667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.120975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.123319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.128789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 249/511] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.128789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.140400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 263/512] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.140588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.146720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb25e57-544c-4ad2-82ac-59c205daf633 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.151879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df38cfa-5f25-4662-93e1-b612ffabac33 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.154229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.155676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.156519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.156797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.157207 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.157779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.158137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.158488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.166122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.168832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.172672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.174892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.183874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:30.185286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 264/513] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.186256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.196218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59c91-39cf-4cc3-9775-16eba26514a8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.196821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:30.199372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 250/514] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.200519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.202137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.203028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.203418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.203815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.215380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0296024-9f69-4816-80b2-23fe7cfff2fa admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.218056 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.220664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.221074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.222081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.222512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.222933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.224583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.225050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.227062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.240619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:30.241073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 251/515] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.246260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.246386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 265/516] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.247607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.257011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7945-de8a-4d7b-9e20-9a0c5f77fda7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.259762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a92a-22fa-4e9f-8efe-33f0541ada4f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.267913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.268518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.268657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.268835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.269112 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.269744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.269869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.270141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.270443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.270853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.271875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.272241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.272912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.275479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.289716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 266/517] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:30.289716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.291582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 252/518] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.295866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.306405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da31f5-2873-4383-a55a-104ded9a7a79 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.307697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00391d-31f7-4543-b3ed-2143895df269 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.312057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.312184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.312720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.313000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.313271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.313575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.313996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.314101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=097a1d32d8fe4b4ca3231950712fa579) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.314403 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.314691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.316784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.323189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.324035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 267/519] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/role_assignments?user.id=097a1d32d8fe4b4ca3231950712fa579&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.325622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.331067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.354120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cdf1a-30d9-42de-8a51-8812fa8cb82e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.358066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 20:23:30.360486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 253/520] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.366213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.367589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.368748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.369178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.370009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.386647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.389210 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85834bd-d1d8-477d-8404-ad6ae38c3cc6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.391705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.402606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.403830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.405055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.405880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.411341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.412793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.417115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.426139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 07 20:23:30.430273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 268/521] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.440600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.451863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 254/522] 10.222.0.60 () {56 vars in 1158 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.454036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0741a9c-2b95-47a2-8047-3b32743406cd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.457398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.459293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.460193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.460667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.461082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.462074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.462577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.464375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:30.464375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:30.464375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:30.465788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.476680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44c663-625b-4f98-841c-4f2607698b5b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.492181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.492847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.493134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.493417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.502118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.509353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 269/523] 10.222.0.60 () {56 vars in 1160 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.514421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.516698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.530087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16b8f7-aec7-4109-ba6d-8c557e7bae53 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.530880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 255/524] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:30.535669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.536509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.536970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.537375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.540400 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.546989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.549101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.558077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b3750-28f3-41ac-a07f-a02fac508173 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.560153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 270/525] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:30.566063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.571667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.573541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.573541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.574767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.582453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46407553-d80f-4521-a7f9-2cbd3a5459e6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.588038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.589313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.589775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.590721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.591166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.591290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.602529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.604758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.608185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:30.609424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 256/526] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.615075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.625277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:30.626058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436100c-f367-4845-bedd-5cda364bb065 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.630804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 271/527] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.632621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.640658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.641544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.641968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.642709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.644129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.645837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.648943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.658364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e83e6-9e4b-46c4-b30a-2f60e6f58a32 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.667647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 257/528] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.667882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.668757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.669222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.669641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.670577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.671037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.673023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.677734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.691326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d6083-fb52-4a5f-87ae-b20ac9b84dc0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.702206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.704456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.705529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.706567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.707666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 272/529] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.715694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.718990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.721223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.731747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7374a-3c4e-4c40-97e0-4ad0ef243df1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.735342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:30.741466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 258/530] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:30.742847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.743334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.744411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.745368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.745784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.759468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46a0db-5dd6-4ed3-8a51-dae07ae0ebef admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.764745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.766090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.767736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.768023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.768306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.769419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.770536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.770906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.774295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.795528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 259/531] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:30.797282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.798656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:30.799897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 273/532] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:30.809348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41b30-6cc0-4801-82b6-761a1e628d86 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.816027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.818739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.819425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.819725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.820008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.820865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=98cad98b2dc54f97a4d72b53b0946802) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.821182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.823665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.834223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ca3d-9bdf-4d3b-98b9-0362d84d71eb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.835148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 260/533] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/role_assignments?user.id=98cad98b2dc54f97a4d72b53b0946802&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.844754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.845602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.845958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.846355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.847384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.847796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.848984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:30.848984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:30.848984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:30.850381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf9407-e722-403f-8822-6d869d56d5f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.887785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 274/534] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.893645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:30.903685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0e3e-6cae-4712-8370-d14713361f53 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:30.912688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8454a32-3049-4b5a-a1a8-f5b55db53375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:30.913492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8454a32-3049-4b5a-a1a8-f5b55db53375 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.913892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8454a32-3049-4b5a-a1a8-f5b55db53375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.914242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8454a32-3049-4b5a-a1a8-f5b55db53375 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.915244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8454a32-3049-4b5a-a1a8-f5b55db53375 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=7b86cad4ee844bdeae28d8a07d8a49b3) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:30.915678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8454a32-3049-4b5a-a1a8-f5b55db53375 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:30.917822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8454a32-3049-4b5a-a1a8-f5b55db53375 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:30.928485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 261/535] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:30 2022] GET /identity/v3/role_assignments?user.id=7b86cad4ee844bdeae28d8a07d8a49b3&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:30.976556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bc0d-ef04-477d-82d8-375516972622 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.976928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bc0d-ef04-477d-82d8-375516972622 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.977374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306bc0d-ef04-477d-82d8-375516972622 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:30.979920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 275/536] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:30.987930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83e38-6473-4941-bc0a-6f7727440099 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:30.988370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83e38-6473-4941-bc0a-6f7727440099 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:30.988752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83e38-6473-4941-bc0a-6f7727440099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:31.017336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1dc83e38-6473-4941-bc0a-6f7727440099 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:31.018571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1dc83e38-6473-4941-bc0a-6f7727440099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:31.031810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 262/537] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:31.081001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306bc0d-ef04-477d-82d8-375516972622 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:31.101222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306bc0d-ef04-477d-82d8-375516972622 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:31.112971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:31.113947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:31.114332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:31.114705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:31.131841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:31.133857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:31.155779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:31.157758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 276/538] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:31.165308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83e38-6473-4941-bc0a-6f7727440099 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:31.174503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83e38-6473-4941-bc0a-6f7727440099 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:31.179917 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ff3a9-fea7-4083-8510-b0808c0de2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:31.180945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff3a9-fea7-4083-8510-b0808c0de2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:31.181428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff3a9-fea7-4083-8510-b0808c0de2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:31.181947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff3a9-fea7-4083-8510-b0808c0de2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:31.184192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ff3a9-fea7-4083-8510-b0808c0de2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:31.184708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ff3a9-fea7-4083-8510-b0808c0de2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:31.186595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ff3a9-fea7-4083-8510-b0808c0de2d1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:31.203248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 263/539] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:31.208755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:31.219841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81284bf-a1d8-4f35-9a33-d825c8c81bb5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:31.225992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050861-a3b7-4a03-a989-ef61532d9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:31.226996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050861-a3b7-4a03-a989-ef61532d9cea admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:31.227549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050861-a3b7-4a03-a989-ef61532d9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:31.228042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050861-a3b7-4a03-a989-ef61532d9cea admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:31.229500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050861-a3b7-4a03-a989-ef61532d9cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:31.231785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050861-a3b7-4a03-a989-ef61532d9cea admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:31.256519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 277/540] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:31 2022] POST /identity/v3/users => generated 247 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:23:32.591692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dae280-04fc-4ca4-a173-38317cb8d4b6 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:32.592208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dae280-04fc-4ca4-a173-38317cb8d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:32.592309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dae280-04fc-4ca4-a173-38317cb8d4b6 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:32.594267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 264/541] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:32.599826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24020626-b120-43d0-b3cb-36231838f698 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:32.600231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24020626-b120-43d0-b3cb-36231838f698 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:32.600396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24020626-b120-43d0-b3cb-36231838f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:32.628652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-24020626-b120-43d0-b3cb-36231838f698 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:32.629842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-24020626-b120-43d0-b3cb-36231838f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:32.643464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 278/542] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:32.679818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dae280-04fc-4ca4-a173-38317cb8d4b6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:32.697438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dae280-04fc-4ca4-a173-38317cb8d4b6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:32.703080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:32.703911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:32.704196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:32.704470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:32.715880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:32.722922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:32.724557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 265/543] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:32.730638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24020626-b120-43d0-b3cb-36231838f698 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:32.740223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24020626-b120-43d0-b3cb-36231838f698 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:32.751555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:32.752250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:32.752536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:32.752818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:32.753612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:32.753984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:32.755681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:32.768355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 279/544] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:32.775421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:32.794965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b767cde-7c75-425c-b59c-64e7b92f37ce admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:32.810101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:32.811512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:32.812029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:32.812543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:32.829734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:32.831630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:32.855446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:32.856955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 266/545] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:32.864036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:32.884618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d282-477a-4d94-8503-74b553b826c7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:32.896544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:32.897228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:32.897516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:32.897803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:32.898557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:32.898870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:32.900516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:32.918706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 280/546] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:32.924021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:32.934011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39b297-afc1-4340-9966-9acc3c535764 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:32.943573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:32.944381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:32.944666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:32.944949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:32.952906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:32.954986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:32.973531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 07 20:23:32.974879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 267/547] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:32.981137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:32.991048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe08a4f-e01d-4cb2-886a-e6e88d632354 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:32.999118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba482e1-151f-45ad-b2e2-af5045113851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:32.999822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba482e1-151f-45ad-b2e2-af5045113851 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.000107 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba482e1-151f-45ad-b2e2-af5045113851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.000389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba482e1-151f-45ad-b2e2-af5045113851 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.001247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba482e1-151f-45ad-b2e2-af5045113851 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:33.001562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba482e1-151f-45ad-b2e2-af5045113851 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.003449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba482e1-151f-45ad-b2e2-af5045113851 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.025538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 281/548] 10.222.0.60 () {56 vars in 1158 bytes} [Mon Feb 7 20:23:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:33.032009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.042439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb9d48-d719-425d-b59f-e14a343a8c69 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.054021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b797e-8e31-4dd7-9555-4eec12dccd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.055425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b797e-8e31-4dd7-9555-4eec12dccd8d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.055425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b797e-8e31-4dd7-9555-4eec12dccd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.055816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b797e-8e31-4dd7-9555-4eec12dccd8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.078807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b797e-8e31-4dd7-9555-4eec12dccd8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.080159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b797e-8e31-4dd7-9555-4eec12dccd8d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.113085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172993d9-33ff-4d90-b48e-50fd2679ff29 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.113383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172993d9-33ff-4d90-b48e-50fd2679ff29 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.113573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172993d9-33ff-4d90-b48e-50fd2679ff29 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.119453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 282/549] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:33.119562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-605b797e-8e31-4dd7-9555-4eec12dccd8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:33.120052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 268/550] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:33.131431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172993d9-33ff-4d90-b48e-50fd2679ff29 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.132949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a340-615d-4b6b-9b00-46412a7c77dd None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.133237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a340-615d-4b6b-9b00-46412a7c77dd None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.133517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a340-615d-4b6b-9b00-46412a7c77dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.164706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172993d9-33ff-4d90-b48e-50fd2679ff29 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.173632 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6e85a340-615d-4b6b-9b00-46412a7c77dd None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:33.176204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6e85a340-615d-4b6b-9b00-46412a7c77dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:33.188875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.189551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.191424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.191424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.191424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:33.191424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.193594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.209656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 269/551] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:33.210650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 283/552] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:33.216428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85a340-615d-4b6b-9b00-46412a7c77dd None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.232658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85a340-615d-4b6b-9b00-46412a7c77dd None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.248448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.249432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.250289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.250566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.254793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.265622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.267769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.273171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fb3ee-ed5a-4aca-bd79-e50e5243bc22 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.301680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:33.305386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 270/553] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:33.308150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.308961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.310358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.310358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.311454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.343719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:33.361847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:33.363342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55fda-967f-493c-bcdc-97db6237facc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.364203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 284/554] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:33.370017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.377344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.378018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.378339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.378635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.388145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:33.388470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.392592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.410626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25639a3-f13a-43b8-b68a-6005c708a493 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.424758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 271/555] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:33.430532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.436345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.437132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.437417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.437701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.438537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:33.438853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.440687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.456914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd804c7e-9a10-4393-9103-6d74f141ab10 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.459457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 285/556] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:33.465934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.474263 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b059-e007-40f9-b6db-ef989f0e8eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.475218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b059-e007-40f9-b6db-ef989f0e8eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.475534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b059-e007-40f9-b6db-ef989f0e8eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.475812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b059-e007-40f9-b6db-ef989f0e8eb7 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/94d4a2ed97744c9fad6b44b5835e260f/roles/3f92e68d5cb34c9d85db9e42baef4925` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.484681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cefbec-f770-4fd0-9204-998da621b194 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.504137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.504967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.505256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.505538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.509587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b059-e007-40f9-b6db-ef989f0e8eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=94d4a2ed97744c9fad6b44b5835e260f, role_id=3f92e68d5cb34c9d85db9e42baef4925)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.513180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b059-e007-40f9-b6db-ef989f0e8eb7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.525272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.528368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.539650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 272/557] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:33 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/94d4a2ed97744c9fad6b44b5835e260f/roles/3f92e68d5cb34c9d85db9e42baef4925 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:23:33.541849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc1a9e-20fe-4cde-9987-3793e2a0d430 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.545012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc1a9e-20fe-4cde-9987-3793e2a0d430 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.545704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc1a9e-20fe-4cde-9987-3793e2a0d430 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.550002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 273/558] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:33.555841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a79572-9e0e-4b97-bb10-577c24da60a8 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.556448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a79572-9e0e-4b97-bb10-577c24da60a8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.557026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a79572-9e0e-4b97-bb10-577c24da60a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.563352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:33.567445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 286/559] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:33.572479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.590875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a4a79572-9e0e-4b97-bb10-577c24da60a8 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:33.593252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a4a79572-9e0e-4b97-bb10-577c24da60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:33.603596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f3ea-1c2f-4687-8e37-83310a598133 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.757494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 274/560] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:33.773862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.774551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.774836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.775115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.775943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:33.776255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.777888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.785709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a79572-9e0e-4b97-bb10-577c24da60a8 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.793866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 287/561] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:33.797887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a79572-9e0e-4b97-bb10-577c24da60a8 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.803781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.805190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.806119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.806499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.807407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.814407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dafd24-eb7e-4fa0-a418-b3ac67016319 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.822243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.822243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.823492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.823814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:33.824071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.832560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.833650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:33.835077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.835224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 275/562] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:33.844342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.851563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:23:33.853141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 288/563] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:33.860351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.871685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9413eb5-b2e7-4d69-88eb-ce24aed19152 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.874713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2c924-1f84-47d9-a234-b93abeed0f8d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.881872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.883323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.884038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.884478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.884915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.886703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:33.887288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.887764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.888181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.888907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.890823 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:33.891896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.892126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.894101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.910813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 276/564] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:33.917579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.931570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55fec2-e93f-4307-b93c-9ea8f5896a60 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.935136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 289/565] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:33.941293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.948421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1fe6f-2ed9-471c-b004-6af3775e2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.949221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1fe6f-2ed9-471c-b004-6af3775e2462 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.949505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1fe6f-2ed9-471c-b004-6af3775e2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.949774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1fe6f-2ed9-471c-b004-6af3775e2462 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.953893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c6bd9-da20-4893-acd7-b12731941a45 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:33.958797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9989af8-640d-4bc2-96c8-54314c1124e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:33.960236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989af8-640d-4bc2-96c8-54314c1124e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.961057 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989af8-640d-4bc2-96c8-54314c1124e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.961492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9989af8-640d-4bc2-96c8-54314c1124e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.963035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1fe6f-2ed9-471c-b004-6af3775e2462 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.965040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1fe6f-2ed9-471c-b004-6af3775e2462 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.973547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9989af8-640d-4bc2-96c8-54314c1124e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:33.976337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9989af8-640d-4bc2-96c8-54314c1124e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:33.983044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-0fb1fe6f-2ed9-471c-b004-6af3775e2462 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:33.984595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 277/566] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:33.985977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bb87-9fc2-479d-accb-e7b556cceace None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:33.986266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bb87-9fc2-479d-accb-e7b556cceace None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:33.986541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bb87-9fc2-479d-accb-e7b556cceace None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:33.988548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 278/567] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:33.993185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bb87-9fc2-479d-accb-e7b556cceace None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:33.997790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d9989af8-640d-4bc2-96c8-54314c1124e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:33.999377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 290/568] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.000747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd395-69a2-48e2-9415-1919b351dbb0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.001174 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd395-69a2-48e2-9415-1919b351dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.001592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fd395-69a2-48e2-9415-1919b351dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.016763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bb87-9fc2-479d-accb-e7b556cceace None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.022343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.023292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.023854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.024305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.024584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-be0fd395-69a2-48e2-9415-1919b351dbb0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:34.025423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.025957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-be0fd395-69a2-48e2-9415-1919b351dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:34.026089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.028068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.034425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 291/569] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:34.035222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd395-69a2-48e2-9415-1919b351dbb0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.043256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 279/570] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.048255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.059411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fd395-69a2-48e2-9415-1919b351dbb0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.060014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81a216-c970-4758-82ed-2f62b0f9184e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.068593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.069407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.069689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.069964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.071731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.072388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.072707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.072982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.073757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.074041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.075676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.085877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.087935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.092873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 292/571] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.094191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.103592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 07 20:23:34.103592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 280/572] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.103592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.111003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e8118-fbc4-4ab9-82b8-4a8f70b61c09 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.116006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.116789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.116920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14713c-8b56-4a3c-9c35-02b8f309bf33 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.117068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.117346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.121875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.122735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.123324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.123701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.129193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:34.132168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.134301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.136596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:34.137938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 293/573] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.138530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.148380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d275-67b3-4f6f-b46f-cacec5998e5a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.150148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:34.151956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 281/574] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.152884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.153004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.153603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.153975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.154258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.155108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.155439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.157684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.165194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62bb91-4c74-402b-ab69-bb7e91c2c72a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.171487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.172255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.173126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.173517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.174652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.175063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.176659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 294/575] 10.222.0.60 () {56 vars in 1160 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.177479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.181087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.187213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a8edc-ad63-47f6-9306-433c7084d475 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.191663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 282/576] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.191783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.192350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.192489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.192628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.193035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.193923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.194229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.196091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.203866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad4e2b-b1ff-4d34-a0d2-9fce554b0686 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.208748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 295/577] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.209436 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.209578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.210304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.210587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.210864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.219454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b63f2-daf5-41b1-af69-7e7522ba9cac admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.223377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.223841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.224603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.224885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.225160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.225672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.235666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.237466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.246160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:34.247484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 283/578] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.248229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.254238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:34.255570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 296/579] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.256189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.263691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33653590-b687-459a-bdb0-65e24e417e64 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.266742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7668dd9-a139-41df-afb4-732132845c45 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.268724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.269621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.269905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.270231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/097a1d32d8fe4b4ca3231950712fa579/roles/3f92e68d5cb34c9d85db9e42baef4925` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.271368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.272218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.272501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.272778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.273541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.273849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.275523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.289571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 297/580] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.290516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.295344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=097a1d32d8fe4b4ca3231950712fa579, role_id=3f92e68d5cb34c9d85db9e42baef4925)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.299450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.300616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38494c33-3f9d-42a3-9f4a-ede8bfdccbce admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.305473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.306185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.306507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.306828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.307789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.308101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.309810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.315326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 284/581] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:34 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/097a1d32d8fe4b4ca3231950712fa579/roles/3f92e68d5cb34c9d85db9e42baef4925 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:34.316401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.326167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 298/582] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.331512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.342317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c650270-a13a-497b-83c7-d3c24175b630 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.399635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b33f5-61d8-4a30-8456-ca7918550cf2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.403008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.403904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.404190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.404467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.405397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.406841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.407300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.408343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.412826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.415193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.416947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.419913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.431057 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 20:23:34.433077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 299/583] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:34.435529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:34.437142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 285/584] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.441058 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.442929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.454788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427b6ce-d77c-413b-90fa-91aa33be94bc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.463753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffadfd-20bb-494d-98a2-51f5c9e294f2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.466678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.468982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.470087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.471086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.472329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.473873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.474245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.475620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.476947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.477444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.479360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.481802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.482377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.485519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.505898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 286/585] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:34.512385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.527366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939b997-7783-49e5-8b78-3e49fb7abd5d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.528065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 300/586] 10.222.0.60 () {56 vars in 1158 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.533784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.539764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65faa6cc-382a-4770-9b94-818ca4d107ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.541036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa6cc-382a-4770-9b94-818ca4d107ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.543353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa6cc-382a-4770-9b94-818ca4d107ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.543871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faa6cc-382a-4770-9b94-818ca4d107ad admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/7b86cad4ee844bdeae28d8a07d8a49b3/roles/3f92e68d5cb34c9d85db9e42baef4925` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.549428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4dd26-31ce-43e2-a2ad-e099ac8f4143 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.555102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf0699-bc8a-4297-bea5-f6ebbf6afb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.555940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0699-bc8a-4297-bea5-f6ebbf6afb9a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.556220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0699-bc8a-4297-bea5-f6ebbf6afb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.556488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf0699-bc8a-4297-bea5-f6ebbf6afb9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.566339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faa6cc-382a-4770-9b94-818ca4d107ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=7b86cad4ee844bdeae28d8a07d8a49b3, role_id=3f92e68d5cb34c9d85db9e42baef4925)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.569228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf0699-bc8a-4297-bea5-f6ebbf6afb9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.570305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65faa6cc-382a-4770-9b94-818ca4d107ad admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.571102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf0699-bc8a-4297-bea5-f6ebbf6afb9a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.588271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 287/587] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:34 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/7b86cad4ee844bdeae28d8a07d8a49b3/roles/3f92e68d5cb34c9d85db9e42baef4925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:23:34.591733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222120d-96db-4aa1-a504-8c7ebd23b187 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.591846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9bbf0699-bc8a-4297-bea5-f6ebbf6afb9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:34.592055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222120d-96db-4aa1-a504-8c7ebd23b187 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.592289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222120d-96db-4aa1-a504-8c7ebd23b187 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.593705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 301/588] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:34.593959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 288/589] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:34.599132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222120d-96db-4aa1-a504-8c7ebd23b187 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.599738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7504e-e5b3-42d1-b933-148e3cb2284f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.600119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7504e-e5b3-42d1-b933-148e3cb2284f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.600633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7504e-e5b3-42d1-b933-148e3cb2284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.626750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b2a7504e-e5b3-42d1-b933-148e3cb2284f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:34.630396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b2a7504e-e5b3-42d1-b933-148e3cb2284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:34.731306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222120d-96db-4aa1-a504-8c7ebd23b187 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.736414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.737094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.737379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.737662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.738420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.738728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.740414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.750327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 302/590] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:34.762300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 289/591] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:34.767790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7504e-e5b3-42d1-b933-148e3cb2284f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.781030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7504e-e5b3-42d1-b933-148e3cb2284f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.783077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.789605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.790421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.790760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.791042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.793884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadc710-5315-4bb7-98b8-1e91171148a0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.798443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.799241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.799559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.799839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.802589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.804700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.815425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:34.823042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:34.824600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 290/592] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:34.825462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:34.826924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 303/593] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.830300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.832826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.841707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc3506-6505-4ef1-936b-74ab6924b62d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.845130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfc49b-2eaf-4e19-8140-d8c213e488f6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.846619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.847511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.847928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.848280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.849115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.849631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.851000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.851648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.852060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.852510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.852969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.854039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:34.854349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.856928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.868007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 291/594] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:34.874056 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 304/595] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:34.879897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.880588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:34.891625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cc515-9bfa-40bf-aa11-280ae4e7f13e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.892154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebedd4-e6ff-4b25-a516-90a97c0a5b0a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:34.896945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.897070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:34.897923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.898328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:34.898430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.898681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.899054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:34.899534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/98cad98b2dc54f97a4d72b53b0946802/roles/3f92e68d5cb34c9d85db9e42baef4925` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:34.914832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.923451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.928388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=98cad98b2dc54f97a4d72b53b0946802, role_id=3f92e68d5cb34c9d85db9e42baef4925)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:34.931101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:34.949455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 292/596] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:34 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/98cad98b2dc54f97a4d72b53b0946802/roles/3f92e68d5cb34c9d85db9e42baef4925 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:34.955854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:34.957400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 305/597] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:34.963821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.034559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f52ce8-bb78-41b3-8220-28f49fb3baa4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.039456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.040191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.040475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.040756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.041608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:35.041975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.043701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.056532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 293/598] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:35.061880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.078049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93fde-7056-49a2-8fe0-749a71a2f9af admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.097190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.098011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.098287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.098557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.106925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.117240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.137369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 20:23:35.138634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 306/599] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:35.144362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.160014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fe8ad-3b50-4e96-9e9c-c7865e5ace6f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.168675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.169508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.169793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.170070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.170987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:35.171304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.173290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.200469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 294/600] 10.222.0.60 () {56 vars in 1156 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:35.205923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.215844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff25531-bbbd-4e7d-820c-bd2d2056b89a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.221209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.221853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.222136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.222473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.230744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.232726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.241977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 307/601] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:35.247847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.257884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba35b7-bb41-45db-9a23-3415d70a0d00 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.263170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.263991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.264328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.264611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.275877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.277789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.296469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:35.297985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 295/602] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:35.303200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.313230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537bf8a-e269-4b2a-8065-5c0e93069662 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.317339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.317990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.318321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.318598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.319381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:35.319738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.321378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.334025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 308/603] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:35.339254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.351411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf917c-ea2a-4be4-8345-5b9ea9b911ca admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.359710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.360496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.360779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.361057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.368658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.371296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.389249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:35.390490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 296/604] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:35.396384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.406517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaf5b9-6b8b-4ad0-a46b-368eac7152aa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.415500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc67e4-97d5-4716-8d52-dc07a9d856f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.416152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc67e4-97d5-4716-8d52-dc07a9d856f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.416574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc67e4-97d5-4716-8d52-dc07a9d856f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.416855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc67e4-97d5-4716-8d52-dc07a9d856f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.417659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc67e4-97d5-4716-8d52-dc07a9d856f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:35.417973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc67e4-97d5-4716-8d52-dc07a9d856f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.419851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc67e4-97d5-4716-8d52-dc07a9d856f0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.439080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 309/605] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:35.445159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:35.456252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0f184-e339-4c04-96ac-5cfa19cc9d33 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:35.463486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b426b-5cee-408e-b28d-5e8adccc2af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:35.464126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b426b-5cee-408e-b28d-5e8adccc2af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:35.464408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b426b-5cee-408e-b28d-5e8adccc2af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:35.464683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b426b-5cee-408e-b28d-5e8adccc2af4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:35.465524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b426b-5cee-408e-b28d-5e8adccc2af4 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=4db726cf28f948108256ecd707c33c85) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:35.465840 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b426b-5cee-408e-b28d-5e8adccc2af4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:35.467842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b426b-5cee-408e-b28d-5e8adccc2af4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:35.474053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 297/606] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:35 2022] GET /identity/v3/role_assignments?user.id=4db726cf28f948108256ecd707c33c85&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:36.247907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5eecd-ef69-4e77-995d-5d1091950db6 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.248658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5eecd-ef69-4e77-995d-5d1091950db6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.248658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5eecd-ef69-4e77-995d-5d1091950db6 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.250506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 310/607] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:36.263848 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4c12-8003-45a6-b95f-9d3261cef3ec None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.264377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4c12-8003-45a6-b95f-9d3261cef3ec None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.264541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce4c12-8003-45a6-b95f-9d3261cef3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.288356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-66ce4c12-8003-45a6-b95f-9d3261cef3ec None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:36.289566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-66ce4c12-8003-45a6-b95f-9d3261cef3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:36.298275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 298/608] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:36.346130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5eecd-ef69-4e77-995d-5d1091950db6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.364625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5eecd-ef69-4e77-995d-5d1091950db6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.369206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.370649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.370931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.371209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.387847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:36.394754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:36.395997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 311/609] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:36.401800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce4c12-8003-45a6-b95f-9d3261cef3ec None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.411093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce4c12-8003-45a6-b95f-9d3261cef3ec None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.420019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.420679 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.420967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.421249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.422015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:36.422323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.423948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.435584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 299/610] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:36.440590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.456404 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e684-db59-4637-bb74-c3ac30af5d81 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.463997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.464795 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.465081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.465357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.476655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.478508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.500667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:36.501808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 312/611] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:36.507474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.520414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c267c92-dec7-4c1f-82bc-cdc390ecc272 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.528696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.529378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.529669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.529953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.530706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:36.531019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.532958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.552308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 300/612] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:36.557323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.572987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c067e3-956e-4612-9904-c234ac73f7e8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.581328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.582121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.582408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.582686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.596563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.598587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.614841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 07 20:23:36.616416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 313/613] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:36.622280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.636907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082a4bf-763a-4fd0-828c-e0d190475568 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.644918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.645585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.645875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.646164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.647995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:36.647995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.649218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.678951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 301/614] 10.222.0.60 () {56 vars in 1158 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:36.684889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.696324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fa550-0c60-4bd3-aa49-56c9ddaf7059 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.705362 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.706013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.706300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.706579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.718911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.720695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.732751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 314/615] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:36.738116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.748592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e32a5d-681a-4be9-a0bc-3386f2eff16a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.760658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.761404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.761686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.761972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.778879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.780769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.804707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:36.806065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 302/616] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:36.811778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.820784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0189b-d062-46d8-b075-3f3760ccb1d8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.831547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.832208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.832496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.832777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.833515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:36.833826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.835427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.857602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 315/617] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:36.862742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.876549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea9bd-eeeb-467c-8fa2-cc2290b5bcd5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.883178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.883989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.884272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.884549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.898229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.900225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.916268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:36.917731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 303/618] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:36.923241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.940409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ffcc-55a6-466d-acd5-fca21da96eb2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:36.953024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef029c3-5713-40ae-91d4-2b053fba3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:36.953697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef029c3-5713-40ae-91d4-2b053fba3af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:36.953982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef029c3-5713-40ae-91d4-2b053fba3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:36.954262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef029c3-5713-40ae-91d4-2b053fba3af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:36.955074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef029c3-5713-40ae-91d4-2b053fba3af3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:36.955382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef029c3-5713-40ae-91d4-2b053fba3af3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:36.957256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef029c3-5713-40ae-91d4-2b053fba3af3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:36.976678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 316/619] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:36.982521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:36.997119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab210fc-4230-490d-9c0a-90c5b67d33fc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.008118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ea7de-1011-45bf-bf32-1661857ac907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.008797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ea7de-1011-45bf-bf32-1661857ac907 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.009083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ea7de-1011-45bf-bf32-1661857ac907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.009359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ea7de-1011-45bf-bf32-1661857ac907 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.010252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ea7de-1011-45bf-bf32-1661857ac907 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=94d4a2ed97744c9fad6b44b5835e260f) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.010564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ea7de-1011-45bf-bf32-1661857ac907 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.012501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ea7de-1011-45bf-bf32-1661857ac907 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.018895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 304/620] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:36 2022] GET /identity/v3/role_assignments?user.id=94d4a2ed97744c9fad6b44b5835e260f&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:37.210692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560135-4629-4938-8db5-387860be8741 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.211014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560135-4629-4938-8db5-387860be8741 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.211253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84560135-4629-4938-8db5-387860be8741 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.213447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 317/621] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:37.218611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee863f-9a81-4d80-bdcd-67afdfabba0c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.218898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee863f-9a81-4d80-bdcd-67afdfabba0c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.219179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee863f-9a81-4d80-bdcd-67afdfabba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.242174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-abee863f-9a81-4d80-bdcd-67afdfabba0c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:37.243408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-abee863f-9a81-4d80-bdcd-67afdfabba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:37.254717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 305/622] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:37.285869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560135-4629-4938-8db5-387860be8741 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.305420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84560135-4629-4938-8db5-387860be8741 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.311990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.312901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.313183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.313465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.324592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:37.331742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:37.333216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 318/623] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:37.339367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee863f-9a81-4d80-bdcd-67afdfabba0c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.349054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee863f-9a81-4d80-bdcd-67afdfabba0c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.354850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ac949-94e1-4814-a2a8-9c1296ac5a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.355552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac949-94e1-4814-a2a8-9c1296ac5a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.355834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac949-94e1-4814-a2a8-9c1296ac5a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.356110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac949-94e1-4814-a2a8-9c1296ac5a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.356873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ac949-94e1-4814-a2a8-9c1296ac5a51 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.357181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ac949-94e1-4814-a2a8-9c1296ac5a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.358779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ac949-94e1-4814-a2a8-9c1296ac5a51 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.368460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 306/624] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:37.373628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.384269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5223-1458-4792-afb7-4d5bcd266807 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.394379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.395179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.395493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.395777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.412303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.412303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.432193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6931-31ce-425f-9bbe-a68a1f96ce2a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.432507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6931-31ce-425f-9bbe-a68a1f96ce2a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.432763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6931-31ce-425f-9bbe-a68a1f96ce2a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.433496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:37.434649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 307/625] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:37.435358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 319/626] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:37.440318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.440767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d183-6d56-4179-a5d3-ac0ece020956 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.441118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d183-6d56-4179-a5d3-ac0ece020956 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.441482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054d183-6d56-4179-a5d3-ac0ece020956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.454524 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cae69d-8404-461d-a4b9-765f622af2d1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.459111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.459792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.460072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.460346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.460660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a054d183-6d56-4179-a5d3-ac0ece020956 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:37.461078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.461381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.461900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a054d183-6d56-4179-a5d3-ac0ece020956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:37.463503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.471869 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 308/627] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:37.480966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 320/628] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:37.481800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d183-6d56-4179-a5d3-ac0ece020956 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.491546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054d183-6d56-4179-a5d3-ac0ece020956 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.496330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.497108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.497385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.497765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.500394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.510535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee36de-8e8d-4d6f-8947-027010fee8da admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.511257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.513499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.515204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.516051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.516331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.516606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.529109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:37.529784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:23:37.531557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 309/629] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:37.536336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:37.536947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.537917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 321/630] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:37.545127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.548677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba43e0-1be2-48fa-886c-776578e3e66f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.553513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.554931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.555214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.555898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.556851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.557166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.557914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1e7e9-982b-454d-9857-cbcd18710806 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.559141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.564178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.564900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.565282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.565609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.566764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.567081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.569931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.579264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 310/631] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:37.580217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 322/632] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:37.585623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.586865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.598081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec90c1d-317c-40a0-ba8b-384dfdbe716b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.598282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545f03-a666-4877-82e2-9004171f413d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.604360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.604667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.605140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.605312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.605458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.605600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.605753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.605908 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.615879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.617189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.617927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.619065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.628309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 311/633] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:37.636023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.643707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:37.644703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45611c6-5fc2-4e16-88e2-2e574d2e340b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.645126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 323/634] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:37.652316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.654767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.655654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.655940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.656518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.662963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f24ac-1569-4661-8533-6c159716ca82 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.668055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.668715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.668891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.669044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.669256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.669998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.670436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.670873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.672022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.685285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 324/635] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:37.690416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.692170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:37.693606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 312/636] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:37.699363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.700700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff05ae-f53b-4bdf-b760-0ffbf54bd173 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.705169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.705954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.706235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.706511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.709453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a03114-5981-4be2-a3bd-d4eb22bd5d3f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.714909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.715528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.715815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.715986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.716151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.716877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.717240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.718037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.718953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.731673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 07 20:23:37.733123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 325/637] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:37.735720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 313/638] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:37.738393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.738584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.748210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61575-1fdf-4f9b-b61a-7564f83999ce admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.748440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4673c-1cc6-4a80-824b-1c3da8b4a4cb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.753031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.753287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.753701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.753868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.754025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.754168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.754320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.754461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.755240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.755578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.757415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.762538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.764594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.777605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 326/639] 10.222.0.60 () {56 vars in 1160 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:37.780343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:37.782233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 314/640] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:37.783097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.787460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.795831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceed8a1-0062-4e73-be8d-9cb0316f2ee2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.797246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fe49a-2b7b-4ef8-86b4-e55e11217080 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.800885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.801684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.801860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.802029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.802224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.802468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.802613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.802882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.803820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.804134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.805985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.810847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.812674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.818026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 315/641] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:37.822303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 327/642] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:23:37.824241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.827936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.836435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81a7e8-5c77-4b35-b7ee-9413949815cd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.842594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b91e-9ae8-4cdb-8f29-a2956e2b5d80 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.843827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.845029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.845602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.846109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.847433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacdcfd-f725-4559-977f-a152e226a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.850672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacdcfd-f725-4559-977f-a152e226a176 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.850672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacdcfd-f725-4559-977f-a152e226a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.850672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacdcfd-f725-4559-977f-a152e226a176 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.850672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacdcfd-f725-4559-977f-a152e226a176 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=097a1d32d8fe4b4ca3231950712fa579) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.850672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacdcfd-f725-4559-977f-a152e226a176 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.851708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacdcfd-f725-4559-977f-a152e226a176 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.858525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 316/643] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/role_assignments?user.id=097a1d32d8fe4b4ca3231950712fa579&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:37.859948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df78c-d108-439b-b545-bad378a22608 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.860237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df78c-d108-439b-b545-bad378a22608 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.860891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df78c-d108-439b-b545-bad378a22608 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.862418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 317/644] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:37.865174 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.869726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e37130-10d9-4ce1-89dd-a50252630735 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.869726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e37130-10d9-4ce1-89dd-a50252630735 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.869726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e37130-10d9-4ce1-89dd-a50252630735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.874008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.889015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-35e37130-10d9-4ce1-89dd-a50252630735 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:37.890355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-35e37130-10d9-4ce1-89dd-a50252630735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:37.894553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:37.896302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 328/645] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:37.902141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 318/646] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:37.902874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.913884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8838af-caa1-4f06-aa89-1dfad2cd8ab9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.918790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.919780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.920284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.920782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.921810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.922292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.924239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.927626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e37130-10d9-4ce1-89dd-a50252630735 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.936781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e37130-10d9-4ce1-89dd-a50252630735 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.937936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 329/647] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:37.942351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.943211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.943611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.943909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.944009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.955208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06ccb3-b3d8-4a2a-845e-f47e101f037e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.956183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:37.960778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.961788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.962306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.962752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.965087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:37.966687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 319/648] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:37.972222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.972882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:37.974857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.983529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47fc19-cf55-4f06-8d10-db2c72eee3d0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:37.988040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:37.988777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:37.989157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:37.989507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:37.990342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:37.990720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:37.991857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:37.992521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:37.993894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 330/649] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:37.999822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.002936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 320/650] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.008376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.011511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6a056-0321-4435-8dd6-a784f4a11590 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.016410 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.017386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.017871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.018322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.019488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.019974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.020569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618541c-ec67-4e09-959f-a64a09c87ba8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.022479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.026291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.027276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.027580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.027930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.039081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 331/651] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:38.043457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.043457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.045682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.056188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909281-99a2-47cf-a623-fc14cfb87bd9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.061320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.062144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:38.062489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.062936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.063434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.063950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 321/652] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:38.064762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=7b86cad4ee844bdeae28d8a07d8a49b3) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.065242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.067350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.069737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.079547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 332/653] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/role_assignments?user.id=7b86cad4ee844bdeae28d8a07d8a49b3&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.080594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3158e-a307-4b96-891b-835ff007e1ae admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.085292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.086060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.086416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.086761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.087637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.088053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.090318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.104340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 322/654] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:38.110042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.121321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354453-5eac-49ad-a2fb-abeb9d05f649 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.125991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.126836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.127122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.127415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.137296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.139512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.154627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 20:23:38.156492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 333/655] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:38.162482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.173216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8edbd0-b331-4f82-8842-8414c331939a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.178097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.178791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.179135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.179439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.180375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.180688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.183199 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.204609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 323/656] 10.222.0.60 () {56 vars in 1158 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.210293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.220802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe94846-2313-4dfa-8f99-657feef2674a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.225516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.226175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.226458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.226739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.236541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.238320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.249992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 334/657] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:38.255604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.266392 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48344de5-a4fa-4a7c-beca-b19f72f0ffb0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.272008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.272935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.273275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.273555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.284972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.286929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.304542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:38.305969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 324/658] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:38.311906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.320990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35389c-7b66-42af-88bb-83e36d82727b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.326182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.326835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.327118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.327417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.328164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.328472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.330122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.343450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 335/659] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.348626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.358546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8c8b-02ba-41f2-8993-c458a4a5f138 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.364956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dd87a-fe77-4a72-b43b-0689566780f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.365765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd87a-fe77-4a72-b43b-0689566780f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.366035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd87a-fe77-4a72-b43b-0689566780f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.366306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dd87a-fe77-4a72-b43b-0689566780f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.374506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd87a-fe77-4a72-b43b-0689566780f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.376476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dd87a-fe77-4a72-b43b-0689566780f9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.396199 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-008dd87a-fe77-4a72-b43b-0689566780f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:38.397723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 325/660] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:38.403376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.409359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7ef0-0332-4049-b8b7-0994aa3a829e None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.409359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7ef0-0332-4049-b8b7-0994aa3a829e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.409819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a7ef0-0332-4049-b8b7-0994aa3a829e None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.411645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 326/661] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:38.415359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a2711-4afc-4f0c-aed8-dee25c19e081 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.419771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678e4b-65f9-4f0e-8ec3-aaa24bdfd51f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.420065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678e4b-65f9-4f0e-8ec3-aaa24bdfd51f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.420345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff678e4b-65f9-4f0e-8ec3-aaa24bdfd51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.425022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.425876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.426305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.426727 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.427722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.428178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.430188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.439222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ff678e4b-65f9-4f0e-8ec3-aaa24bdfd51f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:38.440438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ff678e4b-65f9-4f0e-8ec3-aaa24bdfd51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:38.444914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 336/662] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.456510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.460072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 327/663] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:38.468943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833c3a-ef3b-4155-aa1d-1a74c297c2ca admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.473704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.474352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.474735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.475018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.475953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=98cad98b2dc54f97a4d72b53b0946802) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.476268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.478269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.485233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 337/664] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/role_assignments?user.id=98cad98b2dc54f97a4d72b53b0946802&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.506270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678e4b-65f9-4f0e-8ec3-aaa24bdfd51f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.515949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff678e4b-65f9-4f0e-8ec3-aaa24bdfd51f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.523552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.524357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.524690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.525068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.544511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:38.551815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:38.553794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 328/665] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:38.560327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.575913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38f9ef-477a-47d6-a439-7c2a08774573 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.582067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.582799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.583081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.583431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.584221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.584585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.586255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.599744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 338/666] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.606021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.621613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca9769-8088-4aff-a205-586bbf7864af admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.631828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.632645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.632926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.633203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.653685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.655578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.684425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:38.685938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 329/667] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:38.694096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.708534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cee5e-73d2-48f7-b5a8-5792b579a9e1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.713103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.713764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.714047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.714330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.715073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.715382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.717009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.733564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 339/668] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.739188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.753488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784fd89-a954-407d-82ad-51b4e7a9e134 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.758914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.759964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.760453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.760886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.773625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.775901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.790082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 20:23:38.792344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 330/669] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:38.798011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.815384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7631d1-6790-4a75-91c7-24f477327e48 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.819923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.820684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.821070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.821445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.822427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.822856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.824825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.844422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 340/670] 10.222.0.60 () {56 vars in 1156 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.850096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.860751 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673159fa-f353-4ab8-be79-8e92731ea98c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.870302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.871309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.871867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.872309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.885726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.887782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.907205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:38.908782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 331/671] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:38.914037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.928962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd648d-531e-455b-8ced-db06039b7a99 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.933900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.934718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.935125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.935545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.936407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:38.936821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.938552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:38.954925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 341/672] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:38.960318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:38.970999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b0cbf-531f-481a-af71-ef319530e26b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:38.983908 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:38.985070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:38.985475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:38.985817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:38.995261 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:38.997329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:39.017687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:39.018930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 332/673] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:39.024748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:39.040373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f0b27-b72a-4a8f-8ff8-be5f043863e6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:39.048623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97521981-f17f-45a4-b8e2-cb4938eacf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:39.049293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521981-f17f-45a4-b8e2-cb4938eacf84 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:39.049579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521981-f17f-45a4-b8e2-cb4938eacf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:39.049857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521981-f17f-45a4-b8e2-cb4938eacf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:39.050671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521981-f17f-45a4-b8e2-cb4938eacf84 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:39.050979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521981-f17f-45a4-b8e2-cb4938eacf84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:39.052850 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521981-f17f-45a4-b8e2-cb4938eacf84 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:39.076748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 342/674] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:39.082433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:39.096443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054eaf71-f33e-4ad0-9c18-f398340a64f7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:39.103176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612566e-d128-4685-9da7-80644e557868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:39.104745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612566e-d128-4685-9da7-80644e557868 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:39.105028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612566e-d128-4685-9da7-80644e557868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:39.105307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612566e-d128-4685-9da7-80644e557868 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/4db726cf28f948108256ecd707c33c85/roles/3f92e68d5cb34c9d85db9e42baef4925` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:39.122923 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612566e-d128-4685-9da7-80644e557868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=4db726cf28f948108256ecd707c33c85, role_id=3f92e68d5cb34c9d85db9e42baef4925)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:39.125722 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612566e-d128-4685-9da7-80644e557868 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:39.139683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 333/675] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:39 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/4db726cf28f948108256ecd707c33c85/roles/3f92e68d5cb34c9d85db9e42baef4925 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:40.310683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea762995-24ca-455b-a784-4876de7a702a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.311373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea762995-24ca-455b-a784-4876de7a702a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.311373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea762995-24ca-455b-a784-4876de7a702a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.313347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 343/676] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:40.318860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec262e26-a7dc-4188-a706-c180f1cbffa6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.319337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec262e26-a7dc-4188-a706-c180f1cbffa6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.319514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec262e26-a7dc-4188-a706-c180f1cbffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.339213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ec262e26-a7dc-4188-a706-c180f1cbffa6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:40.340442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ec262e26-a7dc-4188-a706-c180f1cbffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:40.416809 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 334/677] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:40.464866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea762995-24ca-455b-a784-4876de7a702a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:40.481723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea762995-24ca-455b-a784-4876de7a702a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:40.492118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:40.492928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.493209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.493487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.505146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:40.506983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:40.528854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:40.530076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 344/678] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:40.536244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec262e26-a7dc-4188-a706-c180f1cbffa6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:40.545531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec262e26-a7dc-4188-a706-c180f1cbffa6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:40.555741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b4e4d-ee50-4c95-9f9d-19409fa67328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:40.556456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b4e4d-ee50-4c95-9f9d-19409fa67328 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.557306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b4e4d-ee50-4c95-9f9d-19409fa67328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.557597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b4e4d-ee50-4c95-9f9d-19409fa67328 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.558344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b4e4d-ee50-4c95-9f9d-19409fa67328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:40.558652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b4e4d-ee50-4c95-9f9d-19409fa67328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:40.560282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b4e4d-ee50-4c95-9f9d-19409fa67328 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:40.577669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 335/679] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:40.583053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:40.593071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fe552-a655-4925-bcf9-1d80e6f99b7e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:40.597763 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a98b-a72b-4750-a076-2d257ffbabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:40.598433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a98b-a72b-4750-a076-2d257ffbabc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.598777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a98b-a72b-4750-a076-2d257ffbabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.599088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a98b-a72b-4750-a076-2d257ffbabc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.599881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a98b-a72b-4750-a076-2d257ffbabc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:40.601877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a98b-a72b-4750-a076-2d257ffbabc5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:40.630118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 345/680] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:23:40 2022] POST /identity/v3/users => generated 254 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:23:40.932388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10627b8-e7eb-4439-8686-9b7b889b864f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.932718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10627b8-e7eb-4439-8686-9b7b889b864f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.932947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10627b8-e7eb-4439-8686-9b7b889b864f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.935076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 336/681] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:40.940251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3cc03-27aa-464c-8a83-e92ed8cadd4c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.940544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3cc03-27aa-464c-8a83-e92ed8cadd4c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.940830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3cc03-27aa-464c-8a83-e92ed8cadd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.960705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cfe3cc03-27aa-464c-8a83-e92ed8cadd4c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:40.961827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430a8b-b17e-48e1-8e0f-23df806a5ad4 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.962008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cfe3cc03-27aa-464c-8a83-e92ed8cadd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:40.962179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430a8b-b17e-48e1-8e0f-23df806a5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.962376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430a8b-b17e-48e1-8e0f-23df806a5ad4 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.964915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 337/682] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:40.969969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9f24-75eb-4446-b5a8-a9ab15938871 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:40.970250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9f24-75eb-4446-b5a8-a9ab15938871 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:40.970529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9f24-75eb-4446-b5a8-a9ab15938871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:40.970851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 346/683] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:40.991077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-84eb9f24-75eb-4446-b5a8-a9ab15938871 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:40.992258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-84eb9f24-75eb-4446-b5a8-a9ab15938871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:40.994332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3cc03-27aa-464c-8a83-e92ed8cadd4c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.000496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 338/684] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:41.003663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3cc03-27aa-464c-8a83-e92ed8cadd4c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.008345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.009143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.009422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.009699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.022202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:41.030516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb9f24-75eb-4446-b5a8-a9ab15938871 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.032793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:41.034363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 347/685] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:41.040183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.044909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb9f24-75eb-4446-b5a8-a9ab15938871 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.049549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.050580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.051051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.051565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] PATH_INFO: `/v3/services/network` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.052428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.053136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38d46-8119-4971-8efd-bd1b661370ca admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.053934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:41.053934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:41.053934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:41.055266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.058936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.059691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.060078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.060363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.061140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.061858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.064443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.072188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 07 20:23:41.074431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 339/686] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:41.079437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 348/687] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:41.080909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.081031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.091524 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695e22-3177-4652-8cbd-459b12168a64 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.092946 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2caebc-55ed-4477-bcc2-ff0a6c4481fd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.096664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.097662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.097891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.098213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.098597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.099019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.099463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.099877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.100734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.101401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.102964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:41.102964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:41.102964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:41.104710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.110204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.111544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 340/688] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:41.113151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.118647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.131762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1824066-662b-4b1a-8e95-693936e561c2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.137382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.138369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.138836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:41.138945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.139381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.140324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.140724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 349/689] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:41.141084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.142765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.146406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.150056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 341/690] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:41.165211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669f186-3cfa-4ffa-999c-43314b61a83c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.170444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.171530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.172011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.172483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.173484 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.174033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.175925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.189901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 350/691] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:41.195112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.209434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002426-5cd5-4c4a-9357-87938355fa15 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.216161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.216965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.217248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.217524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.227454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.229600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.246991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:23:41.248655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 342/692] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:41.254442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.266911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f56839-8190-4fd0-8a4d-58ccd33d551f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.273272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.274054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.274335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.274609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.275596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.275909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.277972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.304054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 351/693] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:41.306114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.317231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167628f-bbc8-4c05-ac2e-337e33368ddb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.321979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.323308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.327413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.327413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.332998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.334834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.350068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 343/694] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:41.351658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.362264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665b733-aa91-482b-8741-1257e61153cb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.367011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65fe49-db6e-4239-9183-e0d884b5d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.367870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65fe49-db6e-4239-9183-e0d884b5d08f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.368149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65fe49-db6e-4239-9183-e0d884b5d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.368466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65fe49-db6e-4239-9183-e0d884b5d08f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.380412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65fe49-db6e-4239-9183-e0d884b5d08f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.382394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65fe49-db6e-4239-9183-e0d884b5d08f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.404893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1f65fe49-db6e-4239-9183-e0d884b5d08f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:41.406797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 352/695] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:41.412071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.421520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab924-b8fe-42c3-b51d-9429d26923cd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.426094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.426887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.427174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.427543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.428334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.428643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.430229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.443463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 344/696] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:41.447115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7eace-90af-46e0-bfc3-2623678d738d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.448060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7eace-90af-46e0-bfc3-2623678d738d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.448352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7eace-90af-46e0-bfc3-2623678d738d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.449391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.450519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 353/697] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:41.455624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ea90b-221d-4708-836a-2d59b7240561 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.455913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ea90b-221d-4708-836a-2d59b7240561 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.456195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ea90b-221d-4708-836a-2d59b7240561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.460770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe6452-ee95-4213-814e-4e5f283874f8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.472068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.472869 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.473172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.473431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.481164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-086ea90b-221d-4708-836a-2d59b7240561 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:41.482354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-086ea90b-221d-4708-836a-2d59b7240561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:41.487466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.487466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.493865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 354/698] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:41.510976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:41.512516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 345/699] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:41.517818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ea90b-221d-4708-836a-2d59b7240561 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.519488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.531360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25b5a-75bb-4ed8-a668-104486379164 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.533745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ea90b-221d-4708-836a-2d59b7240561 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.540831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.542183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.542467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.542741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.543431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.545039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.545950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.546608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.546882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.547151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.547986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.548287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.550114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.568687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 07 20:23:41.570089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 346/700] 10.222.0.60 () {56 vars in 1150 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:41.576274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.578367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 355/701] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:41.583742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.593381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a208-51d2-44b9-be59-404e666f7dac admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.597942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.598600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.598884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.599165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.600056 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=097a1d32d8fe4b4ca3231950712fa579) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.600365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.601781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa97b7a-4be5-4095-8b01-526e33baf1ec admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.602204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.611267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 356/702] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/role_assignments?user.id=097a1d32d8fe4b4ca3231950712fa579&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:41.611962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ce5d0-e97c-4e56-82df-244254b42682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.612648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ce5d0-e97c-4e56-82df-244254b42682 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.612931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ce5d0-e97c-4e56-82df-244254b42682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.613214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ce5d0-e97c-4e56-82df-244254b42682 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.613964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ce5d0-e97c-4e56-82df-244254b42682 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.614276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ce5d0-e97c-4e56-82df-244254b42682 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.624387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ce5d0-e97c-4e56-82df-244254b42682 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.637776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 347/703] 10.222.0.60 () {56 vars in 1145 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:41.643820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.660909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde705d-d7e8-4386-86e0-c62dac9eeda6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.675643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.676332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.676617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.676958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.677706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:41.678016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:41.679052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:41.679052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:41.679052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:41.679973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166abbb1-1136-40d0-8ecd-46807e423f9d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:41.692699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 357/704] 10.222.0.60 () {56 vars in 1145 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:41.901958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0537-523b-42e4-b914-0c63acb5e3d2 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.902255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0537-523b-42e4-b914-0c63acb5e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.902430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f0537-523b-42e4-b914-0c63acb5e3d2 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.904516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 348/705] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:41.910679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c661f9-02b5-40da-bad3-466e5d6020e5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.910972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c661f9-02b5-40da-bad3-466e5d6020e5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.911262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c661f9-02b5-40da-bad3-466e5d6020e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:41.937730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-01c661f9-02b5-40da-bad3-466e5d6020e5 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:41.938953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-01c661f9-02b5-40da-bad3-466e5d6020e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:41.952201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 358/706] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:41.978100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f0537-523b-42e4-b914-0c63acb5e3d2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:41.993172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f0537-523b-42e4-b914-0c63acb5e3d2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:41.998231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:41.999180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:41.999603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:41.999888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.013018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:42.020196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:42.021462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 349/707] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:42.027361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c661f9-02b5-40da-bad3-466e5d6020e5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.039685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c661f9-02b5-40da-bad3-466e5d6020e5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.047528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.048210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.048494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.048785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.049545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:42.049857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.051501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.063112 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 359/708] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:42.068898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.084528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05441d7-decb-4a55-8e47-5559326ecdf4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.094091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.095120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.095600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.096077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.115175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.117395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.142323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:42.144192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 350/709] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:42.149917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.173644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803be6-9212-4bb1-97b9-ce2525a94ac6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.180900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.182203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.182387 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.182664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.183428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:42.183741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.185342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.204881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 360/710] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:42.210193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.223655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d73b3-64e7-4381-8b0c-eb9b9abe27e7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.232306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.233374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.233817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.234281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.245383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.247664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.271117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 20:23:42.272729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 351/711] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:42.278379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.288745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fdc92-55a3-4c13-b6d0-700f94f470b6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.294246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.295114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.295588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.296034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.297062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:42.297620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.299685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.318622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 361/712] 10.222.0.60 () {56 vars in 1156 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:42.324434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.336025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a925-6f6c-48a3-adf4-f61db2b8cc0e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.343684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.344577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.345022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.345462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.358841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.360630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.374491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 352/713] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:23:42.380028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.396812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e447118-39f2-4a7e-bcf6-70a8f108c469 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.401730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.402743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.403186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.403648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.414764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.418490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.445470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:42.446888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 362/714] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:42.452308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.464346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d4c7e-8764-4aae-af2a-cd18b654862d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.475404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.476141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.476391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.476670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.477423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:42.477735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.479961 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.500535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 353/715] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:42.506239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.520163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebcd28-e512-4ae7-8831-a4a99055ecd0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.527433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.528246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.528505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.528790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.538351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.544633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.559482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:42.561120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 363/716] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:42.566670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.580308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a710c-a43e-4542-9e61-7d8d551dd4d1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.591493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7087d-cb7c-4135-b0ad-88f21eb8742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.592156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7087d-cb7c-4135-b0ad-88f21eb8742e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.592441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7087d-cb7c-4135-b0ad-88f21eb8742e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.592721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7087d-cb7c-4135-b0ad-88f21eb8742e admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.593523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7087d-cb7c-4135-b0ad-88f21eb8742e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:42.593843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7087d-cb7c-4135-b0ad-88f21eb8742e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.595761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7087d-cb7c-4135-b0ad-88f21eb8742e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.612395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 354/717] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:42.618683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:42.629141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94189a93-255f-4c93-a610-dedd874f6685 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:42.639414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50364a3b-2e4f-4911-b81f-3d16839d6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:42.640051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50364a3b-2e4f-4911-b81f-3d16839d6dac admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:42.640373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50364a3b-2e4f-4911-b81f-3d16839d6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:42.640651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50364a3b-2e4f-4911-b81f-3d16839d6dac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:42.641495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50364a3b-2e4f-4911-b81f-3d16839d6dac admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=4db726cf28f948108256ecd707c33c85) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:42.641805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50364a3b-2e4f-4911-b81f-3d16839d6dac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:42.643657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50364a3b-2e4f-4911-b81f-3d16839d6dac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:42.650921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 364/718] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:42 2022] GET /identity/v3/role_assignments?user.id=4db726cf28f948108256ecd707c33c85&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:43.780687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dfccc-32ed-454a-8c84-7601722bf016 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:43.781939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dfccc-32ed-454a-8c84-7601722bf016 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:43.782442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dfccc-32ed-454a-8c84-7601722bf016 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:43.784750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 355/719] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:43.789823 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7dbce-0ec2-44f0-9378-e2c866a4cf40 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:43.790643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7dbce-0ec2-44f0-9378-e2c866a4cf40 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:43.791702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7dbce-0ec2-44f0-9378-e2c866a4cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:43.815566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fbc7dbce-0ec2-44f0-9378-e2c866a4cf40 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:43.817130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fbc7dbce-0ec2-44f0-9378-e2c866a4cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:43.830926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 365/720] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 20:23:43.862737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dfccc-32ed-454a-8c84-7601722bf016 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:43.884163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dfccc-32ed-454a-8c84-7601722bf016 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:43.891995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7ac2b-7f11-48e9-9c6e-5007f56c044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:43.893079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7ac2b-7f11-48e9-9c6e-5007f56c044d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:43.893658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7ac2b-7f11-48e9-9c6e-5007f56c044d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:43.894141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7ac2b-7f11-48e9-9c6e-5007f56c044d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:43.905356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7ac2b-7f11-48e9-9c6e-5007f56c044d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:43.912743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-aed7ac2b-7f11-48e9-9c6e-5007f56c044d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:43.914188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 356/721] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:43.920444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7dbce-0ec2-44f0-9378-e2c866a4cf40 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:43.929809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7dbce-0ec2-44f0-9378-e2c866a4cf40 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:43.940060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:43.941002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:43.941522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:43.942072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:43.943088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:43.943645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:43.945533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:43.953969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571ef3e-3c3a-4b1a-b845-d8fbd8cb0189 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:43.954261 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571ef3e-3c3a-4b1a-b845-d8fbd8cb0189 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:43.954540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571ef3e-3c3a-4b1a-b845-d8fbd8cb0189 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:43.955837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 366/722] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:43.956816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 357/723] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:43.962151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:43.964771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd4c5-852e-41a8-a9ee-64240aa3fcc1 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:43.965061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd4c5-852e-41a8-a9ee-64240aa3fcc1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:43.965346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cd4c5-852e-41a8-a9ee-64240aa3fcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:43.981214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62aeee-3e8f-4839-b48f-24a1c824c541 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:43.983468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f70cd4c5-852e-41a8-a9ee-64240aa3fcc1 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:43.984661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f70cd4c5-852e-41a8-a9ee-64240aa3fcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:43.989641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:43.990727 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:43.991157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:43.991642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:43.992984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 358/724] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 20:23:44.007989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.010613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.016371 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cd4c5-852e-41a8-a9ee-64240aa3fcc1 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.026148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cd4c5-852e-41a8-a9ee-64240aa3fcc1 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.031549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.032277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.032671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.033059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.033958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.035107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:44.035107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:44.035107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:44.036265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.038588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:44.045357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 367/725] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:44.056781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.058920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 359/726] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:23:44 2022] POST /identity/v3/services => generated 240 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:44.074458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83afb5-b50e-479c-ad59-721130584576 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.115592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.116269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.116553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.116832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.117590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.117897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.120089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.136847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 368/727] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:44.142273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.153073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3714a4-eef2-495d-9e6f-bbc9cc8a4efa admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.157945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.158752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.159034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.159312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.168311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.170414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.185928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 20:23:44.187423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 360/728] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:44.192924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.203878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956be2-75dc-448a-8d66-4ab9fe9f57c2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.208492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.209168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.209452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.209731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.210598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.210956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.212924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.235057 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 369/729] 10.222.0.60 () {56 vars in 1170 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:44.240832 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.252103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb41a13-5a02-456a-9e83-ad9c54c35584 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.257004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddd979-405c-4450-b053-593f042ce6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.257672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddd979-405c-4450-b053-593f042ce6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.257957 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddd979-405c-4450-b053-593f042ce6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.258237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddd979-405c-4450-b053-593f042ce6b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.267864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddd979-405c-4450-b053-593f042ce6b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.269641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddd979-405c-4450-b053-593f042ce6b8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.279777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 361/730] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/auth/tokens => generated 1013 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:23:44.285529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.295914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0ff10-f408-491e-a4c2-fefcd9f258e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.304881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.305693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.305974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.306251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.323093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.324973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.340466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5fee8-5240-477e-805e-7c41b083b2c2 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.340771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5fee8-5240-477e-805e-7c41b083b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.341014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5fee8-5240-477e-805e-7c41b083b2c2 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.343054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 362/731] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:44.348093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea20bb4-5b3d-4ebd-9145-a1aa6a21622b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.348628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea20bb4-5b3d-4ebd-9145-a1aa6a21622b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.348628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea20bb4-5b3d-4ebd-9145-a1aa6a21622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.361081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:44.362619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 370/732] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:44.370240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.380888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0350-460c-4d9b-878b-843404454d9a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.382732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9ea20bb4-5b3d-4ebd-9145-a1aa6a21622b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:44.383977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9ea20bb4-5b3d-4ebd-9145-a1aa6a21622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:44.387712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.388381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.388661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.388935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.389743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.390052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.391790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.404664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 371/734] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:44.404955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 363/734] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:44 2022] POST /identity/v3/auth/tokens => generated 1013 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:44.410253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.420234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f183bd-7683-4412-9da0-d3c9c895b198 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.424945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.425721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.426002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.426279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.429834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea20bb4-5b3d-4ebd-9145-a1aa6a21622b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.434442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.437326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.440285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea20bb4-5b3d-4ebd-9145-a1aa6a21622b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.444906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.445729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.446008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.446316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.453435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:44.454962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 372/735] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:44.459761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:44.460594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.467294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:44.473034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4123e8-a682-4623-a169-faa7da962082 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.473292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 364/736] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:44.474403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.477800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.479015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.479301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.479613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.480476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.480792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.482943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.485267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1cb2f-cbaa-4146-9c55-6480f71366f9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.489755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.490402 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.490679 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.490953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.491795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.492101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.493687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.496461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 373/737] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:44.502155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.507495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 365/738] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:44.509485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.513048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085044-fb3c-4a7a-8aac-0936ccfc4fdd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.517812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a00626-a855-4ed9-aedb-5ef858d7ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.518508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00626-a855-4ed9-aedb-5ef858d7ad11 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.518790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00626-a855-4ed9-aedb-5ef858d7ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.519071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00626-a855-4ed9-aedb-5ef858d7ad11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.519623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f9297-abae-4eb0-9cf9-4aa01287192e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.520014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a00626-a855-4ed9-aedb-5ef858d7ad11 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=aa7fcbf331b84fc498a96f46c25d1c50) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.520330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a00626-a855-4ed9-aedb-5ef858d7ad11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.522294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a00626-a855-4ed9-aedb-5ef858d7ad11 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.524183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.525122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.525519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.525706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.528717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 374/739] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/role_assignments?user.id=aa7fcbf331b84fc498a96f46c25d1c50&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:44.537355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.539168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.559746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:44.562747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 366/740] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:44.564720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826751a-2e6c-4681-b2a5-95df775ff1e5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.565017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826751a-2e6c-4681-b2a5-95df775ff1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.565301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826751a-2e6c-4681-b2a5-95df775ff1e5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.567353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 375/741] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:44.567574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.577015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c256a-875a-4555-815e-0ab9a65326b2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.577348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c256a-875a-4555-815e-0ab9a65326b2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.577564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c256a-875a-4555-815e-0ab9a65326b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.578548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4602a-276e-46f9-b21d-029d04985a32 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.583382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.584099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.584377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.584647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.585459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.585764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.587528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.599689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e21c256a-875a-4555-815e-0ab9a65326b2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:44.600930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e21c256a-875a-4555-815e-0ab9a65326b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:44.606062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 367/742] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:44.607669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.612190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 376/743] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:44 2022] POST /identity/v3/auth/tokens => generated 1013 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:44.618063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeade97-85ac-4cca-814b-be3b5a933549 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.623203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.624026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.624323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.624608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.633434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.635614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.649989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c256a-875a-4555-815e-0ab9a65326b2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.650793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:23:44.655539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 368/744] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:44.658394 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.668291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c256a-875a-4555-815e-0ab9a65326b2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.669131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b6fcb-f1ab-4367-bcdc-8b5860cdd8e4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.673739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.674477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.674759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.675084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.676124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.676440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.678466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.681178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.682509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.682792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.683131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.683872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.684921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:44.684921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:44.684921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:44.685816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.705101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 369/745] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:44.707111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.714894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 377/746] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:23:44 2022] POST /identity/v3/services => generated 251 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:44.718176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0249ee-8869-42b0-a2c1-ff4ba41247a6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.733041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.733842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.734119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.734393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.746783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.749209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.779792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:44.781577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 370/747] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:44.787294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.805131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4fd06-48da-4983-bc66-b1a634244a60 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.810623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.811312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.811624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.811909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.812724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.813043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.814845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.839307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 378/748] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:44.845071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.856167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bb5a6-39b6-4e40-861a-62769371a2e9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.860970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.871334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.871334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.871334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.877121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.879124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.893614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:44.899606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 371/749] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:44.901632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.913628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bcd78-53af-4175-9108-13cc20f327f1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.919632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9503f6-fd94-40cc-8bd8-f0d9e37625c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.920297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9503f6-fd94-40cc-8bd8-f0d9e37625c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.920639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9503f6-fd94-40cc-8bd8-f0d9e37625c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.920925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9503f6-fd94-40cc-8bd8-f0d9e37625c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.921732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9503f6-fd94-40cc-8bd8-f0d9e37625c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:44.922099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9503f6-fd94-40cc-8bd8-f0d9e37625c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.924063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9503f6-fd94-40cc-8bd8-f0d9e37625c2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.936796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 379/750] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:44.942815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:44.953599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3c33e-26dc-4160-8cf6-be6ba2ea90d9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:44.958101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc18b6-fb09-42c1-aee8-4379e8a3a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:44.958971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc18b6-fb09-42c1-aee8-4379e8a3a780 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:44.959301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc18b6-fb09-42c1-aee8-4379e8a3a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:44.959612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc18b6-fb09-42c1-aee8-4379e8a3a780 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/097a1d32d8fe4b4ca3231950712fa579/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:44.961662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc18b6-fb09-42c1-aee8-4379e8a3a780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=097a1d32d8fe4b4ca3231950712fa579, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:44.964939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc18b6-fb09-42c1-aee8-4379e8a3a780 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:44.982281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 372/751] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:44 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/097a1d32d8fe4b4ca3231950712fa579/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:45.986824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014eb4-f4e8-46d1-9ab7-67f97f632cca None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:45.987370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014eb4-f4e8-46d1-9ab7-67f97f632cca None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:45.987370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2014eb4-f4e8-46d1-9ab7-67f97f632cca None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:45.989300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 380/752] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:45.994834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e55d8-cac5-4ca9-a4dc-3d57d497e88e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:45.995244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e55d8-cac5-4ca9-a4dc-3d57d497e88e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:45.995488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e55d8-cac5-4ca9-a4dc-3d57d497e88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.013962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c27e55d8-cac5-4ca9-a4dc-3d57d497e88e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:46.015152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c27e55d8-cac5-4ca9-a4dc-3d57d497e88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:46.079144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 373/753] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:45 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:46.115730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014eb4-f4e8-46d1-9ab7-67f97f632cca None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.133153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2014eb4-f4e8-46d1-9ab7-67f97f632cca None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.137659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.138440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.138775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.139062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.152206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:46.159209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:46.164938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 381/754] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:46.170913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e55d8-cac5-4ca9-a4dc-3d57d497e88e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.180302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e55d8-cac5-4ca9-a4dc-3d57d497e88e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.185417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.186086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.186372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.186652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.191449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:46.191796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.193416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.202203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 374/755] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:46.207861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.221768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7713-ec20-44e1-981d-460da6f63fa4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.226375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.227159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.227471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.227757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.243018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.245520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.272715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:46.274298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 382/756] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:46.279644 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.298841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eb635-8a6e-4e52-9b74-c9e58dfc6ac4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.313427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.314094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.314380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.314745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.315522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:46.315835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.317430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.338628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 375/757] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:46.344054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.356307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4df68-3222-4f45-a001-02587ff09812 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.368004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.368784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.369586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.369858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.380621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.382651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.415082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 20:23:46.416682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 383/758] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:46.421942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.436962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b225-82ff-492c-bad4-418dec7bfef5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.453487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.454173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.454456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.454732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.455719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:46.456035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.457912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.491511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 376/759] 10.222.0.60 () {56 vars in 1156 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:46.497494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.513154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d926da-c628-4285-9182-5db0ba8f1954 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.523803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.524473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.524760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.525045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.539477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.541295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.555992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 384/760] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:23:46.561805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.580488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a31d6-e049-42ab-8f6e-ead862dbdd60 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.589250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.590103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.590387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.590701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.609491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.611345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.638259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:46.645569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 377/761] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:46.652096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.664295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f647f7-7e99-4f4b-b4d7-e4ac8802c7d8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.676983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.677616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.677870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.678152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.678894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:46.679209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.680846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.701176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 385/762] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:46.706485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.720871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2f430-5534-4fc3-a960-a2a61ee2851a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.737229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.738042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.738329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.738604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.756542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.758974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.784845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:46.792098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 378/763] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:46.792809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.817825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211ad8-523f-440d-9374-53e9c22f4ed2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.833081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c409b7c-e976-4978-901e-04bac7cd560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.833760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409b7c-e976-4978-901e-04bac7cd560e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.834044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409b7c-e976-4978-901e-04bac7cd560e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.834322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409b7c-e976-4978-901e-04bac7cd560e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.835342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c409b7c-e976-4978-901e-04bac7cd560e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:46.835869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c409b7c-e976-4978-901e-04bac7cd560e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.837881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c409b7c-e976-4978-901e-04bac7cd560e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.860863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 386/764] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:46.866509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:46.889819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f6c19-9f3a-4d3d-9604-76ce1021e0ad admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:46.913906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489c0f2-ee23-4b57-888a-8e01b84ccf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:46.915095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489c0f2-ee23-4b57-888a-8e01b84ccf0c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:46.915504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489c0f2-ee23-4b57-888a-8e01b84ccf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:46.916547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489c0f2-ee23-4b57-888a-8e01b84ccf0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:46.918112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489c0f2-ee23-4b57-888a-8e01b84ccf0c admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=4db726cf28f948108256ecd707c33c85) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:46.918665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489c0f2-ee23-4b57-888a-8e01b84ccf0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:46.921984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489c0f2-ee23-4b57-888a-8e01b84ccf0c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:46.942576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 379/765] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:46 2022] GET /identity/v3/role_assignments?user.id=4db726cf28f948108256ecd707c33c85&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.007701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7351de-a7ab-4573-8bf8-fa4e44df4a7e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.008364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7351de-a7ab-4573-8bf8-fa4e44df4a7e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.008364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7351de-a7ab-4573-8bf8-fa4e44df4a7e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.010449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 387/766] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:47.020560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24fb11-97f0-4c74-9763-38b79a771e47 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.020560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24fb11-97f0-4c74-9763-38b79a771e47 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.020560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24fb11-97f0-4c74-9763-38b79a771e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.046815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ce24fb11-97f0-4c74-9763-38b79a771e47 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:47.048082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ce24fb11-97f0-4c74-9763-38b79a771e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:47.060363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 380/767] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:47.092352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7351de-a7ab-4573-8bf8-fa4e44df4a7e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.116279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7351de-a7ab-4573-8bf8-fa4e44df4a7e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.123771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.124587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.124868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.125146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.125836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.126879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:47.126879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:47.126879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:47.127808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.145212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 07 20:23:47.146806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 388/768] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:47.153379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24fb11-97f0-4c74-9763-38b79a771e47 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.169627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24fb11-97f0-4c74-9763-38b79a771e47 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.187341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.193987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.194240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.194628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.195417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:47.195744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.197391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.208034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 381/769] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.214084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.229280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca437cd-be4d-4f4b-b91c-9465a646d8f6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.235653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.236327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.236615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.236893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.237633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:47.237943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.239600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.245384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 389/770] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.251620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.262198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cad82-2e3e-4651-ac27-c02b3bde5909 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.268705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.269368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.269648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.269924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.270727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] RBAC: Adding query filter params (interface=public, service_id=6ff1365872044f9da024227c2451bcbc, region_id=RegionOne) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:47.271034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.272082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:47.272082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:23:47.272082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:23:47.272960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0e903-7bee-4f04-ace3-7f0f527c2e00 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.286568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 382/771] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/endpoints?service_id=6ff1365872044f9da024227c2451bcbc&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.287982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.306137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d36692-0b64-44f5-a70d-1a5d44cf5e35 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.314724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46b929-1d74-47ab-83a8-4ebf433244bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.315407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b929-1d74-47ab-83a8-4ebf433244bf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.315700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b929-1d74-47ab-83a8-4ebf433244bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.315982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46b929-1d74-47ab-83a8-4ebf433244bf admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.316683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46b929-1d74-47ab-83a8-4ebf433244bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.318291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46b929-1d74-47ab-83a8-4ebf433244bf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.324277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 390/772] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/services => generated 772 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.389188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c32ba-d9e7-4eb5-ae59-f729e6292bd7 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.389742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c32ba-d9e7-4eb5-ae59-f729e6292bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.390106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c32ba-d9e7-4eb5-ae59-f729e6292bd7 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.392175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 383/773] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:47.398110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261685a4-8137-40e3-b6cc-f3ea80869069 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.398424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261685a4-8137-40e3-b6cc-f3ea80869069 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.398665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261685a4-8137-40e3-b6cc-f3ea80869069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.421082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-261685a4-8137-40e3-b6cc-f3ea80869069 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:47.422307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-261685a4-8137-40e3-b6cc-f3ea80869069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:47.440267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 391/774] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:47.476282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c32ba-d9e7-4eb5-ae59-f729e6292bd7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.492667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c32ba-d9e7-4eb5-ae59-f729e6292bd7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.499320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.500256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.500563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.500940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.520746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:47.528756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:47.530096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 384/775] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:47.536616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261685a4-8137-40e3-b6cc-f3ea80869069 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.546290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261685a4-8137-40e3-b6cc-f3ea80869069 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.566019 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.566725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.567013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.567296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.568128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:47.568445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.570084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.584603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 392/776] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.590707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.600794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc1a3-bc0d-4133-aa72-f9ffd2a8ffec admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.609224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.610076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.610361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.610638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.628979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.630832 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.655415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:47.657214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 385/777] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:47.662719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.676899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaf24c-c5dc-448a-8677-b5cc5043be7b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.692665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.693353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.693639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.693921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.694673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:47.694987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.696658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.710611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 393/778] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.716818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.730943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd077ee1-1f4f-4eed-b409-5c58af389fe4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.739717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.740536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.740815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.741093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.750997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.753061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.772971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 20:23:47.774171 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 386/779] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:47.780438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.790653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3eba6-c562-42a7-9fe5-4478253d32c4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.799066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3095e-e169-476c-be68-226f03e8fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.799764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3095e-e169-476c-be68-226f03e8fd09 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.800053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3095e-e169-476c-be68-226f03e8fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.800336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3095e-e169-476c-be68-226f03e8fd09 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.801198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3095e-e169-476c-be68-226f03e8fd09 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:47.801528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3095e-e169-476c-be68-226f03e8fd09 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.803399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3095e-e169-476c-be68-226f03e8fd09 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.821878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 394/780] 10.222.0.60 () {56 vars in 1170 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.827860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.835378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddd652-4ef3-49fc-a665-e9d2a40773c0 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.835682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddd652-4ef3-49fc-a665-e9d2a40773c0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.835968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddd652-4ef3-49fc-a665-e9d2a40773c0 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.838368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 395/781] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:47.844887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de17fa-3b45-4b4c-a9f6-9d31b4c2d441 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.845178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de17fa-3b45-4b4c-a9f6-9d31b4c2d441 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.845451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de17fa-3b45-4b4c-a9f6-9d31b4c2d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.845670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd389c-5284-4536-93a6-ceda8d155a8f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.856352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.857191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.857516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.857797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.865522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-57de17fa-3b45-4b4c-a9f6-9d31b4c2d441 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:47.871803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-57de17fa-3b45-4b4c-a9f6-9d31b4c2d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:47.876472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.879184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.881454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 396/782] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:47.899748 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:47.901838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 387/783] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:47.908691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de17fa-3b45-4b4c-a9f6-9d31b4c2d441 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.920251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.920856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de17fa-3b45-4b4c-a9f6-9d31b4c2d441 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.925489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3142-f484-45d7-8ad8-441a5be32116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.926199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3142-f484-45d7-8ad8-441a5be32116 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.926476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3142-f484-45d7-8ad8-441a5be32116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.926820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3142-f484-45d7-8ad8-441a5be32116 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.927650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3142-f484-45d7-8ad8-441a5be32116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:47.927954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3142-f484-45d7-8ad8-441a5be32116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.929731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3142-f484-45d7-8ad8-441a5be32116 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.931006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e2892-d26d-4cf4-bb1b-d1441e13145b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.935530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f3cfc-2cc0-4063-aa91-6a861e8b8a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.936334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f3cfc-2cc0-4063-aa91-6a861e8b8a2f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.936622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f3cfc-2cc0-4063-aa91-6a861e8b8a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.936901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f3cfc-2cc0-4063-aa91-6a861e8b8a2f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.937576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f3cfc-2cc0-4063-aa91-6a861e8b8a2f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.939182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f3cfc-2cc0-4063-aa91-6a861e8b8a2f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.942518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 397/784] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:47.944138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782bbc-0916-4971-953f-d6250d1a86f2 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.944412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782bbc-0916-4971-953f-d6250d1a86f2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.944691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782bbc-0916-4971-953f-d6250d1a86f2 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.950601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 398/785] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:47.951134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-511f3cfc-2cc0-4063-aa91-6a861e8b8a2f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 07 20:23:47.951450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782bbc-0916-4971-953f-d6250d1a86f2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:47.952812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 388/786] 10.222.0.60 () {56 vars in 1150 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:47.954055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6669d-091d-4f6c-92b6-d68c33e0b823 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.954437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6669d-091d-4f6c-92b6-d68c33e0b823 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.954728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6669d-091d-4f6c-92b6-d68c33e0b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.969966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782bbc-0916-4971-953f-d6250d1a86f2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:47.975511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:47.976355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:47.976634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:47.976912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:47.981381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c9f6669d-091d-4f6c-92b6-d68c33e0b823 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:47.982531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c9f6669d-091d-4f6c-92b6-d68c33e0b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:47.985571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:47.987720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:47.990927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 389/787] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:47.991795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6669d-091d-4f6c-92b6-d68c33e0b823 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.001347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6669d-091d-4f6c-92b6-d68c33e0b823 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.005959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.006484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.006774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.007056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.007818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.008131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.009827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.014695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:48.015479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 390/788] 10.222.0.60 () {56 vars in 1145 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.015955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 399/789] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:48.016521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.025604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.029181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5510a4-5b86-4e5e-a74e-1ac64b3db1cf admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.034148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.034993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.035422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.035680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.038063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b5017-f858-4b14-8659-6b220ce3a1ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.044614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.046035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.046560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.047041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.048375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.048713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:48.049125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.051208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.055999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:48.061973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 391/790] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:48.061973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.068452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc65b8-be07-4b5a-8d89-9e9e90b024b2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.071134 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 400/791] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.072371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.073581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.074246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.074576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.074865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.075661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.075977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.077703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.089386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 392/792] 10.222.0.60 () {56 vars in 1145 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.089386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.090942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616144a-9b4d-400c-823b-d9dc83f5147c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.096714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b77053-2901-42e3-b1e0-17f314b38121 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.097049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.097937 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.098421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.098898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.099944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.100471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.101507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.102429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.102726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.102838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.103081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/aa7fcbf331b84fc498a96f46c25d1c50/roles/3f92e68d5cb34c9d85db9e42baef4925` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.114110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 401/793] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.115649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.120799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=aa7fcbf331b84fc498a96f46c25d1c50, role_id=3f92e68d5cb34c9d85db9e42baef4925)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.123613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.128793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080aa3-8874-497d-8166-2f2379490357 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.134622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.135612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.136142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.136682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.137750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] RBAC: Adding query filter params (interface=public, service_id=78851b722d6e43178376ef72b0c84bf1, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.138306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.139648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 393/794] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:48 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/aa7fcbf331b84fc498a96f46c25d1c50/roles/3f92e68d5cb34c9d85db9e42baef4925 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:48.140153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:48.140153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:48.140153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:48.140598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.141729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.151908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 402/795] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/endpoints?service_id=78851b722d6e43178376ef72b0c84bf1&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.158549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.174971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58168df5-6f2e-4fdc-a00b-5d34af00dcb5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.219108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199f9c-e33b-485e-a173-424267d43be1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.223670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.224455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.224746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.225031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.236797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.238235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.238737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.239493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.239985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.240516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.241495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.243506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.255586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 403/796] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/services => generated 772 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:48.256863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:48.258530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 394/797] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:48.264720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.281407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549feaa-ceba-49f2-96c6-4c809a673b97 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.290652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.291828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.292358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.292858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.293873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.294417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.300685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.314522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 404/798] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.324607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.335437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193512ef-d43c-45a0-b831-43ff5b754ad7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.344508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.345334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.345621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.345897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.362542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.364665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.380045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:23:48.381625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 395/799] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:48.387541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.402960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35335d-d3eb-4171-ae84-a42e096c2f09 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.412038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.413160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.413647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.414160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.415275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.415905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.418111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.439573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 405/800] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.446381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.456172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825c632-7b74-409b-aa1f-4dce83dfff0a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.460797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.461455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.461748 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.462028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.471539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.473377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.487002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 396/801] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:23:48.492143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.503270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d01bf-a20b-4e5c-bccf-1d834bf957f5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.508979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.510560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.511047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.511590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.523596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.525837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.549077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:48.551348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 406/802] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:48.556477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.566029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59902de-7582-4243-8e46-ff5eb1fd4d90 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.571097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.573351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.573870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.574348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.575358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.575895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.577705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.591124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 397/803] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.596102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.606481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22307a79-7773-4b9f-80c1-b769e4352f93 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.612229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.613308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.613826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.614301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.622728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.624970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.639178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:48.640989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 407/804] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:48.646341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.657596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a62de-6767-422b-b673-e577fa99be53 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.662469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c8762-001e-4033-a3cd-d08613df40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.663493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8762-001e-4033-a3cd-d08613df40b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.664024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8762-001e-4033-a3cd-d08613df40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.664549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8762-001e-4033-a3cd-d08613df40b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.665555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c8762-001e-4033-a3cd-d08613df40b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.666106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c8762-001e-4033-a3cd-d08613df40b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.668284 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c8762-001e-4033-a3cd-d08613df40b7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.683270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 398/805] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:48.692498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:48.704602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640287ae-08fc-457e-9181-23398ed5f6fc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:48.716086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855ead0-2d32-4f8b-b6db-0d7e712efbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:48.717184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ead0-2d32-4f8b-b6db-0d7e712efbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:48.717715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ead0-2d32-4f8b-b6db-0d7e712efbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:48.718201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ead0-2d32-4f8b-b6db-0d7e712efbf4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:48.719248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855ead0-2d32-4f8b-b6db-0d7e712efbf4 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=097a1d32d8fe4b4ca3231950712fa579) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:48.719796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855ead0-2d32-4f8b-b6db-0d7e712efbf4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:48.721948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855ead0-2d32-4f8b-b6db-0d7e712efbf4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:48.728994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 408/806] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:48 2022] GET /identity/v3/role_assignments?user.id=097a1d32d8fe4b4ca3231950712fa579&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:49.796963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e996c-8d64-4739-b4d2-47449ee3f4c3 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:49.797473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e996c-8d64-4739-b4d2-47449ee3f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:49.797580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e996c-8d64-4739-b4d2-47449ee3f4c3 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:49.799553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 399/807] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:49.804834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7165f07-90fd-4419-9b4d-023be3b45c35 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:49.805229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7165f07-90fd-4419-9b4d-023be3b45c35 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:49.805432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7165f07-90fd-4419-9b4d-023be3b45c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:49.832579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f7165f07-90fd-4419-9b4d-023be3b45c35 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:49.833828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f7165f07-90fd-4419-9b4d-023be3b45c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:49.844574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 409/808] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:49 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:49.877590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e996c-8d64-4739-b4d2-47449ee3f4c3 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:49.894477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e996c-8d64-4739-b4d2-47449ee3f4c3 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:49.898874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:49.899675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:49.899986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:49.900302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:49.918582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:49.925316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:49.926791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 400/809] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:49.933089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7165f07-90fd-4419-9b4d-023be3b45c35 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:49.945701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7165f07-90fd-4419-9b4d-023be3b45c35 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:49.950437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d45e0-0d09-4372-b917-a2e8ef6b6209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:49.951099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d45e0-0d09-4372-b917-a2e8ef6b6209 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:49.951385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d45e0-0d09-4372-b917-a2e8ef6b6209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:49.951695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d45e0-0d09-4372-b917-a2e8ef6b6209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:49.952461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d45e0-0d09-4372-b917-a2e8ef6b6209 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:49.952770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d45e0-0d09-4372-b917-a2e8ef6b6209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:49.954374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d45e0-0d09-4372-b917-a2e8ef6b6209 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:49.966882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 410/810] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:49.972220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:49.984228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff26ce-667d-401d-bfb5-4bb450d93b83 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:49.993469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:49.994824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:49.995105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:49.995406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:49.997288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ab61f-45e9-4431-b2fb-e22de9f534f5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:49.997591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ab61f-45e9-4431-b2fb-e22de9f534f5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:49.997872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ab61f-45e9-4431-b2fb-e22de9f534f5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:49.999723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 411/811] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:50.004704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b11e-e78e-4ab5-b009-0f1cfd7deebc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.004996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b11e-e78e-4ab5-b009-0f1cfd7deebc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.005276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70b11e-e78e-4ab5-b009-0f1cfd7deebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.007987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.010050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.026460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:50.028219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 401/812] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:50.037896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fb70b11e-e78e-4ab5-b009-0f1cfd7deebc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:50.038218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.039100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fb70b11e-e78e-4ab5-b009-0f1cfd7deebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:50.049760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829fc56-2a67-41f4-97ef-213bc5f05cc5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.056057 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 412/813] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:50.065361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.066248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.066717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.067168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.068132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:50.068632 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.070390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.079311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b11e-e78e-4ab5-b009-0f1cfd7deebc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.091755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70b11e-e78e-4ab5-b009-0f1cfd7deebc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.099984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 402/814] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:50.104426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.105471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.105933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.106385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] PATH_INFO: `/v3/services/network` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.107233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.109054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.110093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.126325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 07 20:23:50.131447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b441b-68f9-4a56-aefc-fe3d404391b0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.132926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 413/815] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/services/network => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:50.138683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.146222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.147575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.148040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.148491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.149049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abaf2b-8749-4c01-82d5-d5bd765afefd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.154160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.154912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.155199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.155510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.156547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:50.156855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.158457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.167417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 414/816] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:50.169535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.171607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.173169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.189331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 20:23:50.190824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 403/817] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:50.193210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15fb86-782d-4b47-b0c7-0329fe99e25c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.196355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.201432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.203416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.203865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.205662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.206545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:50.207745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.211651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.216707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a8244-e5c8-4ab1-944a-4dd8b664a574 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.222037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 415/818] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:50.229639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.230524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.230943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.231405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.232390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:50.232907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.234985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.238310 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.251555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74091ae9-e13b-476a-a582-a5fbeceb8770 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.256585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.258845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.259831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.260273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.261607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.266512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:23:50.266512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:23:50.266512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:23:50.267802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.277930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 404/819] 10.222.0.60 () {56 vars in 1156 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:50.284242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.300404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20483-2ddd-4543-9689-6e6847f16901 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.307556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 416/820] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:23:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:23:50.319613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.320515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.320800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.321076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.332721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.334694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.354311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:50.356011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 405/821] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:50.362059 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.375909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fc4a5-2fec-4362-a0ae-813bfb054f3a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.381628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.382388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.382680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.382966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.383738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:50.384048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.385841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.404013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 417/822] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:50.409713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.426064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb011bb-64b0-4957-8cfc-fd81776f7b81 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.436089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.436918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.437201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.437475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.452713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.454725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.469631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:50.475906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 406/823] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:50.481453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.501086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4493f-c8cc-46d1-831b-7b7c34ff9519 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.509159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8100d2-c509-43bd-b5c9-9a5cddba7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.510494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8100d2-c509-43bd-b5c9-9a5cddba7111 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.510782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8100d2-c509-43bd-b5c9-9a5cddba7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.511061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8100d2-c509-43bd-b5c9-9a5cddba7111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.511943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8100d2-c509-43bd-b5c9-9a5cddba7111 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:50.512257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8100d2-c509-43bd-b5c9-9a5cddba7111 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.514246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8100d2-c509-43bd-b5c9-9a5cddba7111 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.532961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 418/824] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:50.539059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:50.557153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921328b-a8bf-4f24-b1da-c8274ba18ef1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:50.568120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf8fa6-75c3-479d-9ebd-eb8ef2c50306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:50.569034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8fa6-75c3-479d-9ebd-eb8ef2c50306 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.569317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8fa6-75c3-479d-9ebd-eb8ef2c50306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.569595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8fa6-75c3-479d-9ebd-eb8ef2c50306 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/4db726cf28f948108256ecd707c33c85/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.577066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf8fa6-75c3-479d-9ebd-eb8ef2c50306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=4db726cf28f948108256ecd707c33c85, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:50.579919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf8fa6-75c3-479d-9ebd-eb8ef2c50306 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:50.598205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 407/825] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:50 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/4db726cf28f948108256ecd707c33c85/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:50.882226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93fab1-e471-46ba-8e36-15918bccbf0d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.882760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93fab1-e471-46ba-8e36-15918bccbf0d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.882760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93fab1-e471-46ba-8e36-15918bccbf0d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.885303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 419/826] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:50.891543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e556d2-47f9-4efb-b289-e9a882d87f88 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:50.891543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e556d2-47f9-4efb-b289-e9a882d87f88 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:50.891543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e556d2-47f9-4efb-b289-e9a882d87f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:50.910421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-24e556d2-47f9-4efb-b289-e9a882d87f88 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:50.911944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-24e556d2-47f9-4efb-b289-e9a882d87f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:50.975491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 408/827] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:50 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:50.995118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93fab1-e471-46ba-8e36-15918bccbf0d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.007910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93fab1-e471-46ba-8e36-15918bccbf0d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.012444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eceac13-6404-4bc0-a622-196adb70c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.013278 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceac13-6404-4bc0-a622-196adb70c8df admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.013570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceac13-6404-4bc0-a622-196adb70c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.013851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceac13-6404-4bc0-a622-196adb70c8df admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.025938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eceac13-6404-4bc0-a622-196adb70c8df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:51.033348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9eceac13-6404-4bc0-a622-196adb70c8df admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:23:51.034955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 420/828] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:23:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:51.041409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e556d2-47f9-4efb-b289-e9a882d87f88 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.051142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e556d2-47f9-4efb-b289-e9a882d87f88 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.055776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.056552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.056839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.057115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.057937 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.058249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.059875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.066218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b559-5555-4bd6-b243-063098f2337f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.066516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b559-5555-4bd6-b243-063098f2337f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.066798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b559-5555-4bd6-b243-063098f2337f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.069706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 421/829] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:51.071200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 409/830] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:51.076673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1bab-b5ae-46c5-b652-fe52a2682ac0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.076964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1bab-b5ae-46c5-b652-fe52a2682ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.077246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1bab-b5ae-46c5-b652-fe52a2682ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.081254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.093142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105c4e6-2f06-4460-aacf-2b6290e95d32 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.095948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-63bd1bab-b5ae-46c5-b652-fe52a2682ac0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:51.097129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-63bd1bab-b5ae-46c5-b652-fe52a2682ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:51.098536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.099807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.100416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.101016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.105848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 422/831] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:51 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:51.113635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.115772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.129692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1bab-b5ae-46c5-b652-fe52a2682ac0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.132802 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:51.138573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 410/832] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:51.138814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1bab-b5ae-46c5-b652-fe52a2682ac0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.140233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.144551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.145585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.146067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.146548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.147426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.149230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.153448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ac60-cd4b-4f3d-9bb8-da5de63f9182 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.158422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.159343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.159788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.160219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.161122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.161569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.161990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 07 20:23:51.168567 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 423/833] 10.222.0.60 () {56 vars in 1150 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:51.168683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.169962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.181599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff983f0-70af-4094-91b6-0001d735cae0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.182820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 411/834] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:51.185681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.186330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.187202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.187762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.188269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.189265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.189765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.191636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.197944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41b572-feab-405e-befc-a3922c313bdd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.198620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 424/835] 10.222.0.60 () {56 vars in 1145 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:51.203742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.210052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.210846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.211130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.211420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.219228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89daad-757d-4578-9b55-ee2db0038a9d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.219576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.221613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.225504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.226434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.226911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.227380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.228664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.229215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.231057 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.235936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 20:23:51.236796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 425/836] 10.222.0.60 () {56 vars in 1145 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:51.241261 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 412/837] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:51.242640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.244214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.253120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f96183-b40a-4d03-8a9e-832571a70897 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.254031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e9346-7e24-4257-8a14-d92783b4ce9e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.257863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.258588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.258938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.259848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.260645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.260762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.261629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.262084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.262426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.262719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.263871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.264443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.266677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.291435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 426/838] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:23:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:51.298503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 413/839] 10.222.0.60 () {56 vars in 1170 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:51.300816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.327109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3377a0-da07-4428-b995-45bc2a0e87c6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.335303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.336188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.336469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.336802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.346153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.348066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.363585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 427/840] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:23:51.365417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.377618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207283-2a6f-41b4-a518-4ea7dc14eab6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.382696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.383626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.383912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.384188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.396757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.398720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.418884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:51.424282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 414/841] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:51.426429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.436648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a893-e7b0-485f-90c8-007f028855f8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.442958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.443728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.444010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.444332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.445086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.445397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.447148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.466419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 428/842] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:51.467148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.477223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d5924-2ef7-4530-a99a-aaef621f763d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.482447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.483265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.483575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.483856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.490942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.492927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.506630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:51.508193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 415/843] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:51.514067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.525308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a78ad1-18d8-4b5f-adbb-593b3ba5f8e8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.530216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4b7dd-070e-4d76-b359-1c05f0394d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.530947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b7dd-070e-4d76-b359-1c05f0394d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.531523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b7dd-070e-4d76-b359-1c05f0394d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.531805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4b7dd-070e-4d76-b359-1c05f0394d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.532625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4b7dd-070e-4d76-b359-1c05f0394d73 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.532934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4b7dd-070e-4d76-b359-1c05f0394d73 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.534985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4b7dd-070e-4d76-b359-1c05f0394d73 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.549161 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 429/844] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:51.554909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.565918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7b76-6f0f-44c1-94f8-eb08240ad11c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.570496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89733874-2087-40de-bee4-823b0a4905d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.571136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89733874-2087-40de-bee4-823b0a4905d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.571451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89733874-2087-40de-bee4-823b0a4905d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.571731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89733874-2087-40de-bee4-823b0a4905d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.572602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89733874-2087-40de-bee4-823b0a4905d4 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=aa7fcbf331b84fc498a96f46c25d1c50) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.572914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89733874-2087-40de-bee4-823b0a4905d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.574752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89733874-2087-40de-bee4-823b0a4905d4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.581179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 416/845] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/role_assignments?user.id=aa7fcbf331b84fc498a96f46c25d1c50&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:51.814955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dd6f2-cb34-4c8a-9152-191b0daa880f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.815249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dd6f2-cb34-4c8a-9152-191b0daa880f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.815479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dd6f2-cb34-4c8a-9152-191b0daa880f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.817391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 430/846] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:51.822948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d7dd-3ebf-4988-984d-b1f5b335743e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.823239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d7dd-3ebf-4988-984d-b1f5b335743e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.823557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2d7dd-3ebf-4988-984d-b1f5b335743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.843172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-85e2d7dd-3ebf-4988-984d-b1f5b335743e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:51.844478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-85e2d7dd-3ebf-4988-984d-b1f5b335743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:51.854050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 417/847] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:51 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:51.878523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dd6f2-cb34-4c8a-9152-191b0daa880f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.891969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dd6f2-cb34-4c8a-9152-191b0daa880f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.897233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.898311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.898871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.899429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.901376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.903246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.915647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 07 20:23:51.917374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 431/848] 10.222.0.60 () {56 vars in 1153 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:51.923372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d7dd-3ebf-4988-984d-b1f5b335743e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.934348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2d7dd-3ebf-4988-984d-b1f5b335743e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.939274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b506bb-a22c-4705-8b60-1e2291cbd43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.940200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b506bb-a22c-4705-8b60-1e2291cbd43f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.940741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b506bb-a22c-4705-8b60-1e2291cbd43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.941217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b506bb-a22c-4705-8b60-1e2291cbd43f admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.942256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b506bb-a22c-4705-8b60-1e2291cbd43f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.942831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b506bb-a22c-4705-8b60-1e2291cbd43f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.944672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b506bb-a22c-4705-8b60-1e2291cbd43f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.950728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 418/849] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:51.956420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:51.966595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874acf6-79e9-411a-9059-ce04b15b16a2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:51.971461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01334ad5-7690-4c47-8e04-3f088495fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:51.972406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01334ad5-7690-4c47-8e04-3f088495fa9b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:51.972893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01334ad5-7690-4c47-8e04-3f088495fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:51.973423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01334ad5-7690-4c47-8e04-3f088495fa9b admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:51.974375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01334ad5-7690-4c47-8e04-3f088495fa9b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:51.974934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01334ad5-7690-4c47-8e04-3f088495fa9b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:51.976828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01334ad5-7690-4c47-8e04-3f088495fa9b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:51.982532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 432/850] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:23:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:52.964482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e57b1-fc2f-40bc-9007-f09396a87fd2 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:52.964995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e57b1-fc2f-40bc-9007-f09396a87fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:52.965070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e57b1-fc2f-40bc-9007-f09396a87fd2 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:52.967054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 419/851] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:52.972411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3a67-1c5a-4a0b-bd43-4981392301f8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:52.972805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3a67-1c5a-4a0b-bd43-4981392301f8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:52.973000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3a67-1c5a-4a0b-bd43-4981392301f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:52.992456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ef7e3a67-1c5a-4a0b-bd43-4981392301f8 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:52.993670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ef7e3a67-1c5a-4a0b-bd43-4981392301f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:53.002307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 433/852] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:52 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:53.025927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e57b1-fc2f-40bc-9007-f09396a87fd2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.038305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e57b1-fc2f-40bc-9007-f09396a87fd2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.043198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.044063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.044345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.044623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.054897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:53.062416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:23:53.063976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 420/853] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:53.069740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3a67-1c5a-4a0b-bd43-4981392301f8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.078927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3a67-1c5a-4a0b-bd43-4981392301f8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.083507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.084210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.084496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.084774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.085539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.085845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.088006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.097013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 434/854] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:53.102363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.113857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3e65-dc74-4874-adfe-bffed3889422 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.118716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.119572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.119852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.120193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.133206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.135567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.153754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:53.155596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 421/855] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:53.161182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.171720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56291e53-81f5-4a25-b106-36fcffa51cec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.176274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.176923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.177205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.177480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.178215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.178522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.180169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.192310 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 435/856] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:53.197864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.207880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f016a1-b1d7-48cc-817d-00e37e573642 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.213049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.213830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.214167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.214451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.222274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.224337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.239049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 20:23:53.240265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 422/857] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:53.245953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.255819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f51671-674b-4c5c-a75f-5f8a303346b8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.260473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.261140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.261425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.261707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.262734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.263052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.265051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.284325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 436/858] 10.222.0.60 () {56 vars in 1156 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:53.289654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.300251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018bc7c-fe4c-4fc6-a7ff-d128307a6cad admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.304819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.305459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.305742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.306026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.314221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.316077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.325706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 423/859] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:23:53.331552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.342963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29bd5-db88-470c-87e3-302bdc9a8c63 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.347894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.348715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.348996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.349278 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.361720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.363713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.380764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:53.382218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 437/860] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:53.387825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.396976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6d07-b9ea-4e92-988f-28c2e39471eb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.402174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.402823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.403107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.403470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.404213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.404566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.406483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.419214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 424/861] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:53.424646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.434552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c556f-4b5d-463c-9d3b-ac5ec637b3e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.439167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.440020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.440306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.440640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.448388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.450339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.465246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:53.466752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 438/862] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:53.472447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.482415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6838982-e695-45cc-b313-b055d7ecd4b5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.486985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c2256-b80b-4499-a7a8-35daf443bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.487722 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c2256-b80b-4499-a7a8-35daf443bd2a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.488012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c2256-b80b-4499-a7a8-35daf443bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.488298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c2256-b80b-4499-a7a8-35daf443bd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.489098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c2256-b80b-4499-a7a8-35daf443bd2a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.489410 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c2256-b80b-4499-a7a8-35daf443bd2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.491365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c2256-b80b-4499-a7a8-35daf443bd2a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.504641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 425/863] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:53.511102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.526301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da4491-281a-41da-8a7c-b35f8e50e1c6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.530912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391827df-84b1-44f5-a9d9-737f8aecb6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.531849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391827df-84b1-44f5-a9d9-737f8aecb6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.532138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391827df-84b1-44f5-a9d9-737f8aecb6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.532421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391827df-84b1-44f5-a9d9-737f8aecb6fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.533271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391827df-84b1-44f5-a9d9-737f8aecb6fd admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=4db726cf28f948108256ecd707c33c85) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.533586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391827df-84b1-44f5-a9d9-737f8aecb6fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.535455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391827df-84b1-44f5-a9d9-737f8aecb6fd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.541979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 439/864] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/role_assignments?user.id=4db726cf28f948108256ecd707c33c85&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:53.611237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9d50-d6a0-412d-b336-572e0c314408 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.611607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9d50-d6a0-412d-b336-572e0c314408 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.611845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9d50-d6a0-412d-b336-572e0c314408 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.614011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 426/865] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:53.620122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506e4b-f91a-4e52-9167-3e645479554d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.620417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506e4b-f91a-4e52-9167-3e645479554d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.620680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91506e4b-f91a-4e52-9167-3e645479554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.640406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-91506e4b-f91a-4e52-9167-3e645479554d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:53.641541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-91506e4b-f91a-4e52-9167-3e645479554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:53.652172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 440/866] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:53 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:53.675730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9d50-d6a0-412d-b336-572e0c314408 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.688438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9d50-d6a0-412d-b336-572e0c314408 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.692973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.693771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.694049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.694324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.695004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.696654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.709137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 07 20:23:53.714028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 427/867] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:53.717327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91506e4b-f91a-4e52-9167-3e645479554d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.727027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91506e4b-f91a-4e52-9167-3e645479554d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.731860 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc870-b123-4941-8d59-7cdc45f347cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.732560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc870-b123-4941-8d59-7cdc45f347cb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.732870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc870-b123-4941-8d59-7cdc45f347cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.733119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc870-b123-4941-8d59-7cdc45f347cb admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.733908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc870-b123-4941-8d59-7cdc45f347cb admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.734199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc870-b123-4941-8d59-7cdc45f347cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.736007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbc870-b123-4941-8d59-7cdc45f347cb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.741560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 441/868] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:53.748423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:53.761650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a773d03-d68b-4e40-af51-cb1e1d8bb3be admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:53.766173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d150f-75e2-4ed8-b1ac-8eb4cea5bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:53.766828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d150f-75e2-4ed8-b1ac-8eb4cea5bc83 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:53.767233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d150f-75e2-4ed8-b1ac-8eb4cea5bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:53.767558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d150f-75e2-4ed8-b1ac-8eb4cea5bc83 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:53.768289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d150f-75e2-4ed8-b1ac-8eb4cea5bc83 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:53.768595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d150f-75e2-4ed8-b1ac-8eb4cea5bc83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:53.770202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d150f-75e2-4ed8-b1ac-8eb4cea5bc83 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:53.776585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 428/869] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:54.007158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beabf28-36c8-4f02-a6a3-87007fb88372 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.007687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beabf28-36c8-4f02-a6a3-87007fb88372 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.007687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beabf28-36c8-4f02-a6a3-87007fb88372 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.010301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 442/870] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:54.015830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfb892-d7e2-443d-b954-2da4af4d820b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.016316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfb892-d7e2-443d-b954-2da4af4d820b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.016479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfb892-d7e2-443d-b954-2da4af4d820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.034312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-28dfb892-d7e2-443d-b954-2da4af4d820b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:54.035580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-28dfb892-d7e2-443d-b954-2da4af4d820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:54.043536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 429/871] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:54 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:54.068579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beabf28-36c8-4f02-a6a3-87007fb88372 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.081496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beabf28-36c8-4f02-a6a3-87007fb88372 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.085939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.086738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.087024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.087324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.097991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:54.105369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 20:23:54.106867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 443/872] 10.222.0.60 () {56 vars in 1141 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:54.112560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfb892-d7e2-443d-b954-2da4af4d820b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.122276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfb892-d7e2-443d-b954-2da4af4d820b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.126833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.127516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.127804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.128082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.128845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:54.129155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.130752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.139889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 430/873] 10.222.0.60 () {56 vars in 1136 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:54.145322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.155721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e5e4-f54b-456c-a3c7-0dde29f31ba8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.160487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.161254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.161540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.161819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.172081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.173966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.191016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:54.192625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 444/874] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:54.198649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.208288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1b42b-bd28-4b86-9f93-8ee32f4b52c2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.212782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c50b4-10d1-4278-a460-e31ba3a380f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.213432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c50b4-10d1-4278-a460-e31ba3a380f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.213720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c50b4-10d1-4278-a460-e31ba3a380f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.214005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c50b4-10d1-4278-a460-e31ba3a380f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.214741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c50b4-10d1-4278-a460-e31ba3a380f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:54.215054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c50b4-10d1-4278-a460-e31ba3a380f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.216682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c50b4-10d1-4278-a460-e31ba3a380f6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.229034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 431/875] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:54.234304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.244678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c96209-66df-4b5c-9a3f-275be29c56dc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.247603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963cfa0-92f1-47ad-9a92-abc5d149af75 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.248065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963cfa0-92f1-47ad-9a92-abc5d149af75 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.248510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963cfa0-92f1-47ad-9a92-abc5d149af75 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.250473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.250997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 432/876] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:23:54.251658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.252079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.252536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.256388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ba9b1-a128-4af5-823f-4878e4eb4e8e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.256778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ba9b1-a128-4af5-823f-4878e4eb4e8e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.257214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ba9b1-a128-4af5-823f-4878e4eb4e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.261242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.263535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.275536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ba9ba9b1-a128-4af5-823f-4878e4eb4e8e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:54.276822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ba9ba9b1-a128-4af5-823f-4878e4eb4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:54.278431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 20:23:54.280193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 445/877] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:54.286970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.289968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 433/878] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:54 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:54.297917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced7113-8656-4b2c-877c-6c2ef073ecbe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.302577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.303370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.303832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.304256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.305259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:54.305741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.308314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.319433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ba9b1-a128-4af5-823f-4878e4eb4e8e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.327099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 446/879] 10.222.0.60 () {56 vars in 1170 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:54.327718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ba9b1-a128-4af5-823f-4878e4eb4e8e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.332486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.333090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.333373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.333647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.334287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.334404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.336187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.346105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc4c8e-6ce3-4d88-bc74-dae68f808cb5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.351555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 434/880] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:23:54 2022] POST /identity/v3/services => generated 269 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:54.365515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.366884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.367324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.367776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.378972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.381275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.392434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 447/881] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:23:54.400167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.411859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597965e-5b2d-43e6-a980-7be9dc1329f8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.417486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.418662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.419093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.419621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.432374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.434572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.453881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:54.455768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 435/882] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:54.461628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.471832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d1ee1-54fe-4bee-843d-6af0872368d3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.477156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.478640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.479083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.479543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.480473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:54.480980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.482765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.496248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 448/883] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:54.501759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.512236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088110c5-e9e5-43de-b13d-31ec91626496 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.517704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.517704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.517926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.518105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.525863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.527882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.542204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:54.543774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 436/884] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:54.549730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.560501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236598f0-f766-406f-ad28-9c7ed39c53b5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.565276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000728a-4197-49e5-b8a5-4642a9480f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.565943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000728a-4197-49e5-b8a5-4642a9480f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.566281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000728a-4197-49e5-b8a5-4642a9480f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.566569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000728a-4197-49e5-b8a5-4642a9480f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.567385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000728a-4197-49e5-b8a5-4642a9480f64 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:54.567741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000728a-4197-49e5-b8a5-4642a9480f64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.569672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000728a-4197-49e5-b8a5-4642a9480f64 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.583670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 449/885] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:54.589964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:54.601614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626fbae-01c4-4141-89da-5ed9284629a4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:54.606799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b31a1-4b44-43fb-80e1-bb735bf46a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:54.607470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b31a1-4b44-43fb-80e1-bb735bf46a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:54.607877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b31a1-4b44-43fb-80e1-bb735bf46a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:54.608157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b31a1-4b44-43fb-80e1-bb735bf46a31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:54.609058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b31a1-4b44-43fb-80e1-bb735bf46a31 admin admin] RBAC: Adding query filter params (role.id=0cf3d04cfe0647b1bef5400af66e75cf, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=aa7fcbf331b84fc498a96f46c25d1c50) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:54.609423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b31a1-4b44-43fb-80e1-bb735bf46a31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:54.611266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b31a1-4b44-43fb-80e1-bb735bf46a31 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:54.617561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 437/886] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:23:54 2022] GET /identity/v3/role_assignments?user.id=aa7fcbf331b84fc498a96f46c25d1c50&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=0cf3d04cfe0647b1bef5400af66e75cf => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:55.941667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0be21-ee94-4980-b84b-db4496333e7a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:55.942203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0be21-ee94-4980-b84b-db4496333e7a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:55.942203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0be21-ee94-4980-b84b-db4496333e7a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:55.944357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 450/887] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:55.952102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82789c-0e30-43ec-9599-5140444ac41c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:55.952102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82789c-0e30-43ec-9599-5140444ac41c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:55.952102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82789c-0e30-43ec-9599-5140444ac41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:55.969818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0a82789c-0e30-43ec-9599-5140444ac41c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:55.971301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0a82789c-0e30-43ec-9599-5140444ac41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:55.983365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 438/888] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:55 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:56.002103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0be21-ee94-4980-b84b-db4496333e7a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.005605 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82e0d-5aab-4e48-b8a1-cf78aafa00b8 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.006119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82e0d-5aab-4e48-b8a1-cf78aafa00b8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.006589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82e0d-5aab-4e48-b8a1-cf78aafa00b8 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.008897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 439/889] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:56.015296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bf653-1b4b-4f4d-a5d3-0ecf2a8d39f0 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.015624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bf653-1b4b-4f4d-a5d3-0ecf2a8d39f0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.015884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bf653-1b4b-4f4d-a5d3-0ecf2a8d39f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.023354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0be21-ee94-4980-b84b-db4496333e7a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.030665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.031747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.032028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.032298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.033416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.035314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.038746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-046bf653-1b4b-4f4d-a5d3-0ecf2a8d39f0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:56.039971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-046bf653-1b4b-4f4d-a5d3-0ecf2a8d39f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:56.046881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 20:23:56.048091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 440/890] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:56 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:56.053073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 451/891] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:56.054325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bf653-1b4b-4f4d-a5d3-0ecf2a8d39f0 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.064345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bf653-1b4b-4f4d-a5d3-0ecf2a8d39f0 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.068963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.069604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.069882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.070155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.070940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:56.072598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.073129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.074825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.082805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bb164-bc25-460f-af4f-83760d422ea3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.084282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 441/892] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:56.085554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.088987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3825e0c-2eac-4b7c-a906-7e00113cef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.089872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825e0c-2eac-4b7c-a906-7e00113cef08 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.090355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825e0c-2eac-4b7c-a906-7e00113cef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.090849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825e0c-2eac-4b7c-a906-7e00113cef08 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.091844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3825e0c-2eac-4b7c-a906-7e00113cef08 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.093636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3825e0c-2eac-4b7c-a906-7e00113cef08 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.095528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466beb3-53e6-4d3e-b5e1-89cf2ea42bbd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.100434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc9209-b8f2-4a18-8a77-3a0a4a077842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.101119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc9209-b8f2-4a18-8a77-3a0a4a077842 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.101399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc9209-b8f2-4a18-8a77-3a0a4a077842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.101851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc9209-b8f2-4a18-8a77-3a0a4a077842 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.102694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc9209-b8f2-4a18-8a77-3a0a4a077842 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:56.103079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc9209-b8f2-4a18-8a77-3a0a4a077842 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.104745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc9209-b8f2-4a18-8a77-3a0a4a077842 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.110283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 452/894] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:23:56 2022] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:23:56.115658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 442/894] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:56.679007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12771cb-e1a1-414e-8ca0-666dc116810f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.679369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12771cb-e1a1-414e-8ca0-666dc116810f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.679667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12771cb-e1a1-414e-8ca0-666dc116810f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.682321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 443/895] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:56.687208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a65d8-14ce-4187-9d2f-6cebc297dab5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.687527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a65d8-14ce-4187-9d2f-6cebc297dab5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.687814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a65d8-14ce-4187-9d2f-6cebc297dab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.706177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-648a65d8-14ce-4187-9d2f-6cebc297dab5 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:56.707680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-648a65d8-14ce-4187-9d2f-6cebc297dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:56.725049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 453/896] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:56 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:56.748291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12771cb-e1a1-414e-8ca0-666dc116810f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.760538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12771cb-e1a1-414e-8ca0-666dc116810f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.764897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.765690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.765974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.766255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.766921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.768531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.779801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 07 20:23:56.781477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 444/897] 10.222.0.60 () {56 vars in 1153 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:56.787267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a65d8-14ce-4187-9d2f-6cebc297dab5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.797046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a65d8-14ce-4187-9d2f-6cebc297dab5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.801679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.802337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.802623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.802902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.803676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:56.803989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.805586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.811589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 454/898] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:56.816915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.827028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b454-dab3-47df-a595-a6048bf5de44 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.831904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.832806 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.833374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.833843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.834797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:56.835298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.837153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.843418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 445/899] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:56.851711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.867971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea2f8-64ab-48c2-9cd6-5efe3786224f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.874017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d72da4-9c90-4d1c-9027-0a187d6c4100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.874912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72da4-9c90-4d1c-9027-0a187d6c4100 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.875449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72da4-9c90-4d1c-9027-0a187d6c4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.875959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72da4-9c90-4d1c-9027-0a187d6c4100 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.876977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d72da4-9c90-4d1c-9027-0a187d6c4100 admin admin] RBAC: Adding query filter params (interface=public, service_id=cfc63667dbad418e88d02643bc420656, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:56.877519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d72da4-9c90-4d1c-9027-0a187d6c4100 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.879442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d72da4-9c90-4d1c-9027-0a187d6c4100 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.886080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 455/900] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/endpoints?service_id=cfc63667dbad418e88d02643bc420656&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:56.891743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.902321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c413816-c4b8-4790-adab-9091614cc270 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.907459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.908317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.908852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.909311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.910297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:56.912186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:56.916733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382bed4-1bf1-4075-8ece-f111ab79b35d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.917029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382bed4-1bf1-4075-8ece-f111ab79b35d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.917312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382bed4-1bf1-4075-8ece-f111ab79b35d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.919311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 456/901] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:56.920500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 446/902] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:23:56.924670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b9e5-6841-4595-b437-19886e5de184 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.924963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b9e5-6841-4595-b437-19886e5de184 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.925245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b9e5-6841-4595-b437-19886e5de184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:56.945078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d589b9e5-6841-4595-b437-19886e5de184 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:56.946293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d589b9e5-6841-4595-b437-19886e5de184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:56.955048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 457/903] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:56 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:56.979800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:56.990346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c4f00-bb3b-482c-9d39-6dbd46c0f5ed admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:56.995219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:56.996093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:56.996382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:56.996664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.009295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:57.017073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 20:23:57.018677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 447/904] 10.222.0.60 () {56 vars in 1141 bytes} [Mon Feb 7 20:23:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:57.024627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589b9e5-6841-4595-b437-19886e5de184 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.035037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589b9e5-6841-4595-b437-19886e5de184 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.039991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.041288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.041624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.041950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.042742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:57.043051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.044872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.054503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 458/905] 10.222.0.60 () {56 vars in 1136 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:57.060337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.070556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdacb0-1520-499a-87dd-d0437a0843fa admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.075383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.076276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.076608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.076888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.088912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.090788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.109288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:57.111116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 448/906] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:57.116603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.128210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05717ce5-03f2-404e-8fea-d3ad186073a9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.133608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.134302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.134649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.134935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.135728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:57.136039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.137675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.151593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 459/907] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:57.157362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.167765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca6fc5-7688-4a31-82ae-e835c9bc6e01 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.172480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.173280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.173566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.173846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.182009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.184118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.199546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 20:23:57.200981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 449/908] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:57.206569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.216502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57912bb8-bd6e-4ae0-8d6d-dc068fc9b948 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.221184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.221896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.222189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.222465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.223317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:57.223657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.225630 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.244844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 460/909] 10.222.0.60 () {56 vars in 1170 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:57.252665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.262660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f281c-67e2-40cb-a570-86af49f7f9af admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.267273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.268092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.268372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.268652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.279774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.282017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.301184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:57.302581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 450/910] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:57.308535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.318484 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822afe85-ec42-493d-9a64-af336e7c90f3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.323164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.323865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.324148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.324428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.325181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:57.325491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.327154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.339954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 461/911] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:57.345537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.356064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eb883-b152-4242-82db-b6e748e70d5d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.360760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.361545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.361829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.362163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.369993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.372140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.385616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:23:57.387113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 451/912] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:57.392861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.402686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244322c-8450-465c-880e-108ef9127b4d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.407566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e9099-baae-45a2-8d2b-b3bc6c87bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.408268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9099-baae-45a2-8d2b-b3bc6c87bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.408554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9099-baae-45a2-8d2b-b3bc6c87bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.408837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e9099-baae-45a2-8d2b-b3bc6c87bd16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.409691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e9099-baae-45a2-8d2b-b3bc6c87bd16 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:57.410005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e9099-baae-45a2-8d2b-b3bc6c87bd16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.411931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e9099-baae-45a2-8d2b-b3bc6c87bd16 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.427617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 462/913] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:57.433514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:57.443952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30eb5-d68f-440b-9e0a-f32c2598776a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:57.448550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7287a-bd74-432c-9df4-e44e3871f3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:57.449410 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7287a-bd74-432c-9df4-e44e3871f3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:57.449754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7287a-bd74-432c-9df4-e44e3871f3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:57.449982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7287a-bd74-432c-9df4-e44e3871f3fc admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/aa7fcbf331b84fc498a96f46c25d1c50/roles/0cf3d04cfe0647b1bef5400af66e75cf` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:57.452272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7287a-bd74-432c-9df4-e44e3871f3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=aa7fcbf331b84fc498a96f46c25d1c50, role_id=0cf3d04cfe0647b1bef5400af66e75cf)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:57.455014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7287a-bd74-432c-9df4-e44e3871f3fc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:57.470699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 452/914] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:23:57 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/aa7fcbf331b84fc498a96f46c25d1c50/roles/0cf3d04cfe0647b1bef5400af66e75cf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:23:58.416417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbe65-c6d7-435d-addb-18cc12cc65dd None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.416938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbe65-c6d7-435d-addb-18cc12cc65dd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.417015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dbe65-c6d7-435d-addb-18cc12cc65dd None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.419048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 463/915] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:58.424602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6e67-007a-454f-baab-3e7859d02677 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.425022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6e67-007a-454f-baab-3e7859d02677 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.425193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6e67-007a-454f-baab-3e7859d02677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.442569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-b88c6e67-007a-454f-baab-3e7859d02677 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:58.443765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b88c6e67-007a-454f-baab-3e7859d02677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:58.471254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270da4-a0e3-4413-9a8f-f4c54a44b191 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.471589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270da4-a0e3-4413-9a8f-f4c54a44b191 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.471861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73270da4-a0e3-4413-9a8f-f4c54a44b191 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.477708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 464/916] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:58.478951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f677f-9f82-4e64-8f63-7f0876cb2359 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.479233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f677f-9f82-4e64-8f63-7f0876cb2359 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.479535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f677f-9f82-4e64-8f63-7f0876cb2359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.499410 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-373f677f-9f82-4e64-8f63-7f0876cb2359 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:58.500749 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-373f677f-9f82-4e64-8f63-7f0876cb2359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:58.504970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 453/917] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:58 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:58.514924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 465/918] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:58 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:58.533214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6e67-007a-454f-baab-3e7859d02677 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:58.537835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f677f-9f82-4e64-8f63-7f0876cb2359 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:58.542423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6e67-007a-454f-baab-3e7859d02677 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:58.547102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:58.547792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.548027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f677f-9f82-4e64-8f63-7f0876cb2359 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:58.548210 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.548360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.549081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:58.550683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:58.552706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:58.554214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.554938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.555074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.556476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:58.558373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:58.566609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 454/919] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:23:58 2022] POST /identity/v3/services => generated 241 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:58.571656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 07 20:23:58.573252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 466/920] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:23:58.579886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:58.603159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b590-0293-4988-91ae-1846dbbca02f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:58.608639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:58.609721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.610255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.610734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.611733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:58.612260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:58.614127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:58.620580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 455/921] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:23:58.631433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:58.638018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277f24-d1fc-4e83-b578-a8a801c8c3a0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:58.643046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:58.643811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.644103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.644382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.645126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:58.645436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:58.647045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:58.657921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 467/922] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:23:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:58.660623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:58.671495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673c758-1348-4fe8-a65c-bc73f5226c69 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:58.676472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289185b-248a-45b1-b649-ee72f90ffdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:58.677191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289185b-248a-45b1-b649-ee72f90ffdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.677481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289185b-248a-45b1-b649-ee72f90ffdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.677765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289185b-248a-45b1-b649-ee72f90ffdb9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.678584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289185b-248a-45b1-b649-ee72f90ffdb9 admin admin] RBAC: Adding query filter params (interface=public, service_id=daab024a156b46c28719f2c6408e19e9, region_id=RegionOne) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:58.678953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289185b-248a-45b1-b649-ee72f90ffdb9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:58.680674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289185b-248a-45b1-b649-ee72f90ffdb9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:58.687535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 456/923] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:23:58 2022] GET /identity/v3/endpoints?service_id=daab024a156b46c28719f2c6408e19e9&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:58.693234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:58.704730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499fc1a-9b94-4c27-94dd-fd5656945e4e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:58.709721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3158d-9382-4346-8f96-0f80e7fd7ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:58.710503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3158d-9382-4346-8f96-0f80e7fd7ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:58.710791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3158d-9382-4346-8f96-0f80e7fd7ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:58.711124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3158d-9382-4346-8f96-0f80e7fd7ff7 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:58.711928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3158d-9382-4346-8f96-0f80e7fd7ff7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:58.713728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3158d-9382-4346-8f96-0f80e7fd7ff7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:58.721166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 468/924] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:23:58 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:23:59.291793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee804-83ac-4435-8051-1843bafb6f05 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.292492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee804-83ac-4435-8051-1843bafb6f05 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.292991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee804-83ac-4435-8051-1843bafb6f05 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.295219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 457/925] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:59.300805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c0027-217e-434e-b8fd-c6affb0c9708 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.301329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c0027-217e-434e-b8fd-c6affb0c9708 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.301825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c0027-217e-434e-b8fd-c6affb0c9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.319848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-774c0027-217e-434e-b8fd-c6affb0c9708 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:59.321323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-774c0027-217e-434e-b8fd-c6affb0c9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:59.329694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 469/926] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:59 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:23:59.354385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee804-83ac-4435-8051-1843bafb6f05 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.367550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee804-83ac-4435-8051-1843bafb6f05 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.372428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.373450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.373952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.374428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.375301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.377127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:59.389251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 07 20:23:59.391001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 458/927] 10.222.0.60 () {56 vars in 1153 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:59.397292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c0027-217e-434e-b8fd-c6affb0c9708 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.407954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c0027-217e-434e-b8fd-c6affb0c9708 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.412871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.413781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.414291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.414896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.416479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:59.417455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.419367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:59.425693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 470/928] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:59.431852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.443277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f8eeb-0d2e-45c3-b931-bf134e3f4f38 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.449346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be86c0-3779-4879-9ac0-abe410107429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.450415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be86c0-3779-4879-9ac0-abe410107429 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.450903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be86c0-3779-4879-9ac0-abe410107429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.451427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be86c0-3779-4879-9ac0-abe410107429 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.452477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be86c0-3779-4879-9ac0-abe410107429 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:59.452990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be86c0-3779-4879-9ac0-abe410107429 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.454809 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be86c0-3779-4879-9ac0-abe410107429 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:59.460736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 459/929] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:59.467078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.477196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99db0-77ca-496e-9614-318324f46b8c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.482189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaf010-ce4d-4ae7-87ac-d9d2a6dc9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.483090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf010-ce4d-4ae7-87ac-d9d2a6dc9856 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.483679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf010-ce4d-4ae7-87ac-d9d2a6dc9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.484162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaf010-ce4d-4ae7-87ac-d9d2a6dc9856 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.485237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaf010-ce4d-4ae7-87ac-d9d2a6dc9856 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.487041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaf010-ce4d-4ae7-87ac-d9d2a6dc9856 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:59.511215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 471/930] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:23:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:23:59.702900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ee80-e287-4614-b7b7-425e3cb468b7 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.703274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ee80-e287-4614-b7b7-425e3cb468b7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.703579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15ee80-e287-4614-b7b7-425e3cb468b7 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.705616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 460/931] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:23:59.711723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8b56-e41e-42ec-838b-747f978e843e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.711723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8b56-e41e-42ec-838b-747f978e843e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.711723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8b56-e41e-42ec-838b-747f978e843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.732276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bd6c8b56-e41e-42ec-838b-747f978e843e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:23:59.733481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bd6c8b56-e41e-42ec-838b-747f978e843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:23:59.753311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 472/932] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:23:59 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:23:59.777825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15ee80-e287-4614-b7b7-425e3cb468b7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.790651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15ee80-e287-4614-b7b7-425e3cb468b7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.795376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.796431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.796950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.797436 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.808681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:23:59.816139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 20:23:59.817803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 461/933] 10.222.0.60 () {56 vars in 1141 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:59.824331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8b56-e41e-42ec-838b-747f978e843e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.833633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8b56-e41e-42ec-838b-747f978e843e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.839186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.840197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.840733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.841227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.842247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:59.842751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.844664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:59.854168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 473/934] 10.222.0.60 () {56 vars in 1136 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:59.860080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.874981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146705a-432c-453c-a852-5e1a8051471d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.880366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.881641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.882128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.882674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.894380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.896624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:59.914886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:23:59.917211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 462/935] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:23:59.922997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.933143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4367cc-3953-47bf-be61-d68faadf9b41 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.938176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.939100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.939664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.940139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.941117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:23:59.941668 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.943539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:23:59.955886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 474/936] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:23:59.961557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:23:59.974786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98239d-d9bb-4120-aa4a-a5421f865851 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:23:59.979972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:23:59.980771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:23:59.981052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:23:59.981335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:23:59.988838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:23:59.990844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.011493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 20:24:00.013012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 463/937] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:23:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:00.018607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.029190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0326208-6e0d-4392-85ad-428321cbc894 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.034239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.035123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.035658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.036130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.037169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:00.037698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.039774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.058522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 475/938] 10.222.0.60 () {56 vars in 1170 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:00.064042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.073928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c837ed4-b171-41db-88a8-94a1afba01d6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.078852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.079789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.080352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.080843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.095434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.095434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.100920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 464/939] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:00.107177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.120901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5b371-2996-40b4-aa5f-a57e7269263f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.125641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.126700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.127232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.127772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.138156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.140279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.157817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:24:00.159526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 476/940] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:00.165829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.175025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ba46-d515-4058-b002-95f9cb29397c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.179987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.180886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.181384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.181878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.182862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:00.183441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.185287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.197920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 465/941] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:00.203614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.214430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa68ffd-6875-42aa-b05f-f11bcc80bd87 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.219495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.220575 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.221101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.221589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.229046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.231276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.244611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:24:00.246389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 477/942] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:00.252274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.263002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079e9ef-cd68-4449-a386-3f1c58e3a4fd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.267833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df993388-c9c5-4efb-b4bd-52adb5484738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.268547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df993388-c9c5-4efb-b4bd-52adb5484738 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.268838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df993388-c9c5-4efb-b4bd-52adb5484738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.269238 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df993388-c9c5-4efb-b4bd-52adb5484738 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.270049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df993388-c9c5-4efb-b4bd-52adb5484738 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:00.270363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df993388-c9c5-4efb-b4bd-52adb5484738 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.272359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df993388-c9c5-4efb-b4bd-52adb5484738 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.285980 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 466/943] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:00.292709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.305892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49dd3-4027-448b-bc35-84357d4fddc9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.310707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3baa67-e80a-4f29-b6fa-9415e0d011c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.311362 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3baa67-e80a-4f29-b6fa-9415e0d011c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.311727 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3baa67-e80a-4f29-b6fa-9415e0d011c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.312064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3baa67-e80a-4f29-b6fa-9415e0d011c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.312919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3baa67-e80a-4f29-b6fa-9415e0d011c5 admin admin] RBAC: Adding query filter params (role.id=0cf3d04cfe0647b1bef5400af66e75cf, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=aa7fcbf331b84fc498a96f46c25d1c50) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:00.313302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3baa67-e80a-4f29-b6fa-9415e0d011c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.315844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3baa67-e80a-4f29-b6fa-9415e0d011c5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.323227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 478/944] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/role_assignments?user.id=aa7fcbf331b84fc498a96f46c25d1c50&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=0cf3d04cfe0647b1bef5400af66e75cf => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:00.866574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c35ec-4086-4047-aa31-9e77e94eae40 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.867091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c35ec-4086-4047-aa31-9e77e94eae40 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.867168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c35ec-4086-4047-aa31-9e77e94eae40 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.869774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 467/945] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:00.880889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a612-bfcd-4b76-b2b1-ff9bf52a596a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.881697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a612-bfcd-4b76-b2b1-ff9bf52a596a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.882183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16a612-bfcd-4b76-b2b1-ff9bf52a596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.902172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-da16a612-bfcd-4b76-b2b1-ff9bf52a596a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:00.903703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-da16a612-bfcd-4b76-b2b1-ff9bf52a596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:00.912364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 479/946] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:00 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:00.935618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c35ec-4086-4047-aa31-9e77e94eae40 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.948796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c35ec-4086-4047-aa31-9e77e94eae40 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.953420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.954438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.954935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.955425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.956286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.958083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:00.969507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 20:24:00.971357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 468/947] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:00.977401 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16a612-bfcd-4b76-b2b1-ff9bf52a596a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:00.987301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16a612-bfcd-4b76-b2b1-ff9bf52a596a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:00.992160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5612f-6e42-4e0b-8a2b-0bafc6fc3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:00.993035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5612f-6e42-4e0b-8a2b-0bafc6fc3793 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:00.994109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5612f-6e42-4e0b-8a2b-0bafc6fc3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:00.994603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5612f-6e42-4e0b-8a2b-0bafc6fc3793 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:00.995550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5612f-6e42-4e0b-8a2b-0bafc6fc3793 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:00.996070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5612f-6e42-4e0b-8a2b-0bafc6fc3793 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:00.997863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5612f-6e42-4e0b-8a2b-0bafc6fc3793 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.007509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 480/948] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:01.009369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.012739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad56b-55e6-44aa-a352-1d72394173f6 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.013024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad56b-55e6-44aa-a352-1d72394173f6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.013300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ad56b-55e6-44aa-a352-1d72394173f6 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.015275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 481/949] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:01.020173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4de94-d08b-4a03-8acd-f1ebe8e43cbe None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.020460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4de94-d08b-4a03-8acd-f1ebe8e43cbe None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.020739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4de94-d08b-4a03-8acd-f1ebe8e43cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.021930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093a6d0-50bd-4952-afc8-a5fd9fbd5662 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.027320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.029067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.029559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.030036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.030956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:01.031782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.034025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.038506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-24f4de94-d08b-4a03-8acd-f1ebe8e43cbe None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:01.039801 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-24f4de94-d08b-4a03-8acd-f1ebe8e43cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:01.041297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 469/950] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:01.046905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.051268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 482/951] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:01 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:24:01.061440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c17ec3-f442-4e41-b3a9-c90b4cfd6421 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.066354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.067279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.067810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.068334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.069481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] RBAC: Adding query filter params (interface=public, service_id=23b6586f489546b893f3b3f5e459f647, region_id=RegionOne) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:01.069991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.071901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.074826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4de94-d08b-4a03-8acd-f1ebe8e43cbe None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.078089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 470/952] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/endpoints?service_id=23b6586f489546b893f3b3f5e459f647&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:01.084342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.085993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4de94-d08b-4a03-8acd-f1ebe8e43cbe None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.091972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.093061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.093551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dc5d8-45a3-42af-b7d5-e7513ced2c08 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.093799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.094361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.095319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.097479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.098020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.098657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.098915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.099193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.099910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.101676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.111979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 07 20:24:01.113783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 483/954] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:24:01.113905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 471/954] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:24:01.121814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.132819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377051f0-7e06-44d2-80d2-7b2369edb749 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.138287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.139379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.140001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.140535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.141480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:01.142043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.143988 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.150440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 472/955] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:01.156826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.168309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b01cc-9975-4776-b653-2be60d280c36 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.173924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bbc00-59f7-4dfc-8dec-49f3b0728080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.175012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bbc00-59f7-4dfc-8dec-49f3b0728080 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.175557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bbc00-59f7-4dfc-8dec-49f3b0728080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.176083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bbc00-59f7-4dfc-8dec-49f3b0728080 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.177029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bbc00-59f7-4dfc-8dec-49f3b0728080 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:01.177589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bbc00-59f7-4dfc-8dec-49f3b0728080 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.179518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bbc00-59f7-4dfc-8dec-49f3b0728080 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.186533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 484/956] 10.222.0.60 () {56 vars in 1135 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:01.192630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.203501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc46d1-feaa-490d-9b2e-f3c851c45592 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.208998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6afca-89d1-4165-b174-ce3758f3bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.210024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6afca-89d1-4165-b174-ce3758f3bf8f admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.210533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6afca-89d1-4165-b174-ce3758f3bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.211008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6afca-89d1-4165-b174-ce3758f3bf8f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.212108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6afca-89d1-4165-b174-ce3758f3bf8f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.213413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-8ea6afca-89d1-4165-b174-ce3758f3bf8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:24:01.213413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:24:01.213413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:24:01.214732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6afca-89d1-4165-b174-ce3758f3bf8f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.240873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 473/957] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:24:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:01.858517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e51e-c139-4972-9068-e41bb1997303 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.858833 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e51e-c139-4972-9068-e41bb1997303 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.859082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e51e-c139-4972-9068-e41bb1997303 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.861092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 485/958] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:01.866536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93538-ac32-4bbb-b5b6-7c46223c6917 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.866811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93538-ac32-4bbb-b5b6-7c46223c6917 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.867331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93538-ac32-4bbb-b5b6-7c46223c6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.889997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-b2d93538-ac32-4bbb-b5b6-7c46223c6917 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:01.891180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b2d93538-ac32-4bbb-b5b6-7c46223c6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:01.908426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 474/959] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:01 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:01.930737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5e51e-c139-4972-9068-e41bb1997303 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.944138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5e51e-c139-4972-9068-e41bb1997303 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.948867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.949912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.950391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.950872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.951851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.953622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.964783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 07 20:24:01.966478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 486/960] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:01.972707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d93538-ac32-4bbb-b5b6-7c46223c6917 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:01.982543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d93538-ac32-4bbb-b5b6-7c46223c6917 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:01.987363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a699db-c070-41df-bab1-856f2de0db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:01.988312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a699db-c070-41df-bab1-856f2de0db73 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:01.988790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a699db-c070-41df-bab1-856f2de0db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:01.989259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a699db-c070-41df-bab1-856f2de0db73 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:01.990168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a699db-c070-41df-bab1-856f2de0db73 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:01.990819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a699db-c070-41df-bab1-856f2de0db73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:01.992642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a699db-c070-41df-bab1-856f2de0db73 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:01.998563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 475/961] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:24:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:02.004417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:02.015939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c5d26-8242-4a9e-a25c-4f180498ebbf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:02.020836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465f02a-21f0-48a3-b57d-e8b7bfc95da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:02.021717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f02a-21f0-48a3-b57d-e8b7bfc95da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:02.022191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f02a-21f0-48a3-b57d-e8b7bfc95da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:02.022665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465f02a-21f0-48a3-b57d-e8b7bfc95da4 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:02.023604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465f02a-21f0-48a3-b57d-e8b7bfc95da4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:02.024120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465f02a-21f0-48a3-b57d-e8b7bfc95da4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:02.026043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465f02a-21f0-48a3-b57d-e8b7bfc95da4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:02.030997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 487/962] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:24:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:02.581975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5509-0f3e-416f-8953-46c1c13af99a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:02.582365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5509-0f3e-416f-8953-46c1c13af99a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:02.582555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5509-0f3e-416f-8953-46c1c13af99a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:02.584584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 476/963] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:02.590394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f97da-e518-4d15-96ae-5f957cecf46f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:02.590686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f97da-e518-4d15-96ae-5f957cecf46f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:02.590966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f97da-e518-4d15-96ae-5f957cecf46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:02.608743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-168f97da-e518-4d15-96ae-5f957cecf46f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:02.609915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-168f97da-e518-4d15-96ae-5f957cecf46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:02.617876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 488/964] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:02 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:24:02.639813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a5509-0f3e-416f-8953-46c1c13af99a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:02.652128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a5509-0f3e-416f-8953-46c1c13af99a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:02.656905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:02.657684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:02.657968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:02.658237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:02.658906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:02.660526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:02.671807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 07 20:24:02.673248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 477/965] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Feb 7 20:24:02 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:02.679066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f97da-e518-4d15-96ae-5f957cecf46f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:02.688610 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f97da-e518-4d15-96ae-5f957cecf46f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:02.693212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c800d4-45cc-4075-a77c-942b9b26be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:02.693929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c800d4-45cc-4075-a77c-942b9b26be11 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:02.694212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c800d4-45cc-4075-a77c-942b9b26be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:02.694488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c800d4-45cc-4075-a77c-942b9b26be11 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:02.695270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c800d4-45cc-4075-a77c-942b9b26be11 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:02.695610 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c800d4-45cc-4075-a77c-942b9b26be11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:02.697326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c800d4-45cc-4075-a77c-942b9b26be11 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:02.702552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 489/966] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:02.708021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:02.717870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eac00-cf78-444f-b5c2-7816318d4f6f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:02.722437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26d3f5-15bc-4566-a8f8-36b12f7c1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:02.723090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d3f5-15bc-4566-a8f8-36b12f7c1af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:02.723373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d3f5-15bc-4566-a8f8-36b12f7c1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:02.723676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26d3f5-15bc-4566-a8f8-36b12f7c1af5 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:02.724390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d3f5-15bc-4566-a8f8-36b12f7c1af5 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:02.724984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d3f5-15bc-4566-a8f8-36b12f7c1af5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:02.726287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26d3f5-15bc-4566-a8f8-36b12f7c1af5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:02.731859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 478/967] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:03.379308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885f2e8-74c0-4d66-be3e-300a0cfac455 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.379882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885f2e8-74c0-4d66-be3e-300a0cfac455 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.379882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885f2e8-74c0-4d66-be3e-300a0cfac455 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.381882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 490/968] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:03.387369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37360ba-1700-4500-a4e3-414d000087eb None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.388209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37360ba-1700-4500-a4e3-414d000087eb None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.388740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37360ba-1700-4500-a4e3-414d000087eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.407072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a37360ba-1700-4500-a4e3-414d000087eb None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:03.408614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a37360ba-1700-4500-a4e3-414d000087eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:03.417420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 479/969] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:03 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:24:03.440902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885f2e8-74c0-4d66-be3e-300a0cfac455 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:03.453545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885f2e8-74c0-4d66-be3e-300a0cfac455 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:03.458194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d02c4-1e78-453b-912d-7482f5b1903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:03.459299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d02c4-1e78-453b-912d-7482f5b1903a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.459813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d02c4-1e78-453b-912d-7482f5b1903a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.460383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d02c4-1e78-453b-912d-7482f5b1903a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.461253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d02c4-1e78-453b-912d-7482f5b1903a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:03.463065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d02c4-1e78-453b-912d-7482f5b1903a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:03.474599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4c8d02c4-1e78-453b-912d-7482f5b1903a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 20:24:03.476365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 491/970] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:24:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:03.483013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37360ba-1700-4500-a4e3-414d000087eb None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:03.492514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37360ba-1700-4500-a4e3-414d000087eb None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:03.497454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:03.498364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.498849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.499326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.500299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:03.500818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:03.502602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:03.508341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 480/971] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:03.511440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315690f9-11c3-4c7b-8f1b-4430df6cf88f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.511440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315690f9-11c3-4c7b-8f1b-4430df6cf88f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.511440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315690f9-11c3-4c7b-8f1b-4430df6cf88f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.512826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 492/972] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:03.516642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:03.518338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0660-c78f-426e-8d63-0d397bb2a4ef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.518787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0660-c78f-426e-8d63-0d397bb2a4ef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.519201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf0660-c78f-426e-8d63-0d397bb2a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.526131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82960-d5db-4383-95cc-bfd7870fd131 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:03.530952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:03.531954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.532306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.532674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.533463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:03.533836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:03.535536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:03.539912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2daf0660-c78f-426e-8d63-0d397bb2a4ef None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:03.541255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 481/973] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:03.541625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2daf0660-c78f-426e-8d63-0d397bb2a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:03.546665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:03.559412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a555-c3c3-4c7b-99a4-0ac82ee0d3b6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:03.559787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 493/974] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:03 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:24:03.561471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:03.562249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.562598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.562976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.563839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:03.565592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:03.579281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0660-c78f-426e-8d63-0d397bb2a4ef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:03.586669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 482/975] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:24:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:03.590079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf0660-c78f-426e-8d63-0d397bb2a4ef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:03.606924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:03.608047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.608511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.609008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.609970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:03.612231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:03.613885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.common [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 07 20:24:03.636155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.sql.core [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 07 20:24:03.636155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 07 20:24:03.636155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [parameters: {'id': '410f4a52b15d4d4487678498d9aa2f33', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 07 20:24:03.636155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 07 20:24:03.652884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 410f4a52b15d4d4487678498d9aa2f33.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 410f4a52b15d4d4487678498d9aa2f33. Feb 07 20:24:03.658637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 494/976] 10.222.0.60 () {60 vars in 1161 bytes} [Mon Feb 7 20:24:03 2022] POST /identity/v3/projects => generated 262 bytes in 76 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:03.661485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:03.672415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d957e-98cc-4c3d-b2fd-222b98c6eb6a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:03.677333 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6787-01ab-4eef-b16c-ec28024141c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:03.678173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6787-01ab-4eef-b16c-ec28024141c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.678454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6787-01ab-4eef-b16c-ec28024141c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.678747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6787-01ab-4eef-b16c-ec28024141c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.691646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6787-01ab-4eef-b16c-ec28024141c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:03.694860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6787-01ab-4eef-b16c-ec28024141c5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:03.718675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-ef2e6787-01ab-4eef-b16c-ec28024141c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:24:03.725009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 483/977] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:03.726807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:03.739236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c08ee-a1ee-4e51-a35b-b9855b4bced6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:03.744677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac988e1c-5d80-417c-a7ec-8d2abef4b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:03.745357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac988e1c-5d80-417c-a7ec-8d2abef4b03f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:03.745689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac988e1c-5d80-417c-a7ec-8d2abef4b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:03.745965 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac988e1c-5d80-417c-a7ec-8d2abef4b03f admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:03.746802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac988e1c-5d80-417c-a7ec-8d2abef4b03f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:03.747111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac988e1c-5d80-417c-a7ec-8d2abef4b03f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:03.749402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac988e1c-5d80-417c-a7ec-8d2abef4b03f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:03.775488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 495/978] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:24:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:04.299508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fadc4-7f9a-44f3-85bd-bbd574a063c8 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:04.299904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fadc4-7f9a-44f3-85bd-bbd574a063c8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:04.300098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fadc4-7f9a-44f3-85bd-bbd574a063c8 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:04.301971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 484/979] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:04.308088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606961b5-bba9-4a4a-be67-d58a0a342749 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:04.308603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606961b5-bba9-4a4a-be67-d58a0a342749 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:04.309098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606961b5-bba9-4a4a-be67-d58a0a342749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:04.327446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-606961b5-bba9-4a4a-be67-d58a0a342749 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:04.329277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-606961b5-bba9-4a4a-be67-d58a0a342749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:04.338186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 496/980] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:04 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:04.361244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fadc4-7f9a-44f3-85bd-bbd574a063c8 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:04.373701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fadc4-7f9a-44f3-85bd-bbd574a063c8 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:04.378422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfcad-ec76-43ef-b03e-9a5b619a25a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:04.379298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfcad-ec76-43ef-b03e-9a5b619a25a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:04.379814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfcad-ec76-43ef-b03e-9a5b619a25a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:04.380290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfcad-ec76-43ef-b03e-9a5b619a25a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:04.381320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dfcad-ec76-43ef-b03e-9a5b619a25a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:04.383105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dfcad-ec76-43ef-b03e-9a5b619a25a9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:04.402634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 485/981] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:24:04 2022] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:05.007773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c48f1-cc74-4915-b9db-67e44190872a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:05.008283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c48f1-cc74-4915-b9db-67e44190872a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:05.008391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c48f1-cc74-4915-b9db-67e44190872a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:05.010851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 497/982] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:05.016295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7237-138e-4ade-bfa9-99c22d25ffab None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:05.016591 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7237-138e-4ade-bfa9-99c22d25ffab None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:05.016874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7237-138e-4ade-bfa9-99c22d25ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:05.035135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6b1f7237-138e-4ade-bfa9-99c22d25ffab None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:05.036358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6b1f7237-138e-4ade-bfa9-99c22d25ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:05.052662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 486/983] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:05 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:05.076028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c48f1-cc74-4915-b9db-67e44190872a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:05.088908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c48f1-cc74-4915-b9db-67e44190872a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:05.093375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcb45f-f65b-43bf-abab-53c32c6e7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:05.094023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb45f-f65b-43bf-abab-53c32c6e7bdb admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:05.094306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb45f-f65b-43bf-abab-53c32c6e7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:05.094583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb45f-f65b-43bf-abab-53c32c6e7bdb admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:05.095324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcb45f-f65b-43bf-abab-53c32c6e7bdb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:05.096945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcb45f-f65b-43bf-abab-53c32c6e7bdb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:05.113785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 498/984] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:24:05 2022] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:05.902930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95a34a-e57d-4c7f-8b1a-f2f4a23798bd None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:05.903447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95a34a-e57d-4c7f-8b1a-f2f4a23798bd None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:05.903558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95a34a-e57d-4c7f-8b1a-f2f4a23798bd None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:05.905533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 487/985] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:05.911190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac1e1-80bd-4b48-9671-61101f4c81fc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:05.911510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac1e1-80bd-4b48-9671-61101f4c81fc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:05.911793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac1e1-80bd-4b48-9671-61101f4c81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:05.931039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7d9ac1e1-80bd-4b48-9671-61101f4c81fc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:05.932344 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7d9ac1e1-80bd-4b48-9671-61101f4c81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:05.950129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 499/986] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:05 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:05.973270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95a34a-e57d-4c7f-8b1a-f2f4a23798bd None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:05.986205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95a34a-e57d-4c7f-8b1a-f2f4a23798bd None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:05.990654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:05.991508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:05.991792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:05.992066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:05.992729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:05.994386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.005772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 20:24:06.011511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 488/987] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:24:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:06.013475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ac1e1-80bd-4b48-9671-61101f4c81fc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.022587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ac1e1-80bd-4b48-9671-61101f4c81fc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.027958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.028616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.028898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.029178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.029907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:06.030214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.032141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.037581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 500/988] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:06.043183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.053041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0399ec2-c0a6-43ff-ad18-860d0b81df35 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.058412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b10469-07ae-48fa-a5c3-3a337d30c552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.059295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10469-07ae-48fa-a5c3-3a337d30c552 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.059801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10469-07ae-48fa-a5c3-3a337d30c552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.060271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10469-07ae-48fa-a5c3-3a337d30c552 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.061194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b10469-07ae-48fa-a5c3-3a337d30c552 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:06.061707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b10469-07ae-48fa-a5c3-3a337d30c552 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.063516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b10469-07ae-48fa-a5c3-3a337d30c552 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.072562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 489/989] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:06.076026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.086027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b88b7-ce60-4d59-be61-0151278a7110 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.090924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.091827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.092319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.092807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.093799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] RBAC: Adding query filter params (interface=admin, service_id=23b6586f489546b893f3b3f5e459f647, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:06.094319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.096207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.105740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 501/990] 10.222.0.60 () {56 vars in 1270 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/endpoints?service_id=23b6586f489546b893f3b3f5e459f647&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:06.107724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c69f-2c62-4611-82bd-160c125d0030 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.108020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c69f-2c62-4611-82bd-160c125d0030 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.108306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157c69f-2c62-4611-82bd-160c125d0030 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.109035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.110311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 490/991] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:06.115340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0beb5a-a926-48a1-be82-470f7044e898 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.115664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0beb5a-a926-48a1-be82-470f7044e898 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.115952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0beb5a-a926-48a1-be82-470f7044e898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.120930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51323afd-d694-4022-9363-8ac867afb5dc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.129527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.130158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.130444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.131161 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.131932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.134397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.137451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-db0beb5a-a926-48a1-be82-470f7044e898 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:06.138855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-db0beb5a-a926-48a1-be82-470f7044e898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:06.141482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 502/992] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/services => generated 1957 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:24:06.152296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 491/993] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:06 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:24:06.177635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.188648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca3c34-ca85-4b1d-bf96-940131e2cf54 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.193491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.194182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.194466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.194743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.195503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.197940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.213135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.sql.core [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 07 20:24:06.213135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 07 20:24:06.213135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [parameters: {'user_id': 'daf0e8fcddcd44c19c2d816de671e6d1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 07 20:24:06.213135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 07 20:24:06.219328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 07 20:24:06.221031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 503/994] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:24:06 2022] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:06.227260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0beb5a-a926-48a1-be82-470f7044e898 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.237672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0beb5a-a926-48a1-be82-470f7044e898 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.242528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba50290-5b6f-4bf3-8c6d-74780709f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.243940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50290-5b6f-4bf3-8c6d-74780709f771 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.244223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50290-5b6f-4bf3-8c6d-74780709f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.244502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba50290-5b6f-4bf3-8c6d-74780709f771 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.253093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50290-5b6f-4bf3-8c6d-74780709f771 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.255196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba50290-5b6f-4bf3-8c6d-74780709f771 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.270521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-9ba50290-5b6f-4bf3-8c6d-74780709f771 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 20:24:06.272180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 492/995] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:06.278546 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.292026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb68bdf-1947-4602-b826-2c917d32f989 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.297117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1eff2-2df4-4cbd-908c-8e9b3cca944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.297859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1eff2-2df4-4cbd-908c-8e9b3cca944b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.298201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1eff2-2df4-4cbd-908c-8e9b3cca944b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.298486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1eff2-2df4-4cbd-908c-8e9b3cca944b admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.299327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1eff2-2df4-4cbd-908c-8e9b3cca944b admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:06.299682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1eff2-2df4-4cbd-908c-8e9b3cca944b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.301998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1eff2-2df4-4cbd-908c-8e9b3cca944b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.343743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 504/996] 10.222.0.60 () {56 vars in 1122 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:06.673058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b2f6-ce6d-43f8-a826-1ef054e46b52 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.673423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b2f6-ce6d-43f8-a826-1ef054e46b52 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.673613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b2f6-ce6d-43f8-a826-1ef054e46b52 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.675472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 493/997] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:06.681335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316897-a345-4769-9b5f-710988603239 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.681629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316897-a345-4769-9b5f-710988603239 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.681907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316897-a345-4769-9b5f-710988603239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.700476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7c316897-a345-4769-9b5f-710988603239 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:06.701989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7c316897-a345-4769-9b5f-710988603239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:06.709879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 505/998] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:06 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:06.735917 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65b2f6-ce6d-43f8-a826-1ef054e46b52 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.748323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65b2f6-ce6d-43f8-a826-1ef054e46b52 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.752627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.753393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.753669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.753939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.754596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.756202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.767281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 07 20:24:06.768561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 494/999] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:24:06.774193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c316897-a345-4769-9b5f-710988603239 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.783491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c316897-a345-4769-9b5f-710988603239 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.787992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.788714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.789076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.789442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.790239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:06.790614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.792310 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.797375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 506/1000] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:06.802915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.812859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae06169-3bc7-4758-a7f8-4d3e768e7a17 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.817322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.817963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.818243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.818517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.819228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:06.819562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.821150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.826613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 495/1001] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:06.832092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.842150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d98c-69af-4eb1-9b49-bad4017a6605 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.849485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b14e50-fad2-4755-9b5e-317d45e969de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.849485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14e50-fad2-4755-9b5e-317d45e969de admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.849485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14e50-fad2-4755-9b5e-317d45e969de admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.849485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14e50-fad2-4755-9b5e-317d45e969de admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.853074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14e50-fad2-4755-9b5e-317d45e969de admin admin] RBAC: Adding query filter params (interface=public, service_id=ffdc355c966145bdaf90f317d2649a0c, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:06.853505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14e50-fad2-4755-9b5e-317d45e969de admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.855225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b14e50-fad2-4755-9b5e-317d45e969de admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.861080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 507/1002] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/endpoints?service_id=ffdc355c966145bdaf90f317d2649a0c&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:06.866719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:06.877955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185314-ef9e-4f39-917d-4fb978d2a886 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:06.882514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4558bf8-dbdd-4885-b976-e5557cffe1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:06.883374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4558bf8-dbdd-4885-b976-e5557cffe1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:06.884359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4558bf8-dbdd-4885-b976-e5557cffe1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:06.884719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4558bf8-dbdd-4885-b976-e5557cffe1a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:06.885493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4558bf8-dbdd-4885-b976-e5557cffe1a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:06.887169 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4558bf8-dbdd-4885-b976-e5557cffe1a9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:06.893829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 496/1003] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:24:06 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:24:07.387152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865560-d6c1-4775-af42-beb0f87fc591 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:07.387701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865560-d6c1-4775-af42-beb0f87fc591 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:07.387778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865560-d6c1-4775-af42-beb0f87fc591 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:07.389642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 508/1004] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:07.394659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129d98-4d2a-4e49-910e-3f7dfd31ec0d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:07.395030 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129d98-4d2a-4e49-910e-3f7dfd31ec0d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:07.395217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129d98-4d2a-4e49-910e-3f7dfd31ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:07.413240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e3129d98-4d2a-4e49-910e-3f7dfd31ec0d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:07.414408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e3129d98-4d2a-4e49-910e-3f7dfd31ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:07.422546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 497/1005] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:07 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:07.444685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb865560-d6c1-4775-af42-beb0f87fc591 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:07.456430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb865560-d6c1-4775-af42-beb0f87fc591 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:07.460673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:07.461435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:07.461731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:07.462508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:07.463255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:07.465217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:07.475796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 07 20:24:07.477096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 509/1006] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Feb 7 20:24:07 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:07.483461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3129d98-4d2a-4e49-910e-3f7dfd31ec0d None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:07.492414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3129d98-4d2a-4e49-910e-3f7dfd31ec0d None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:07.497414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:07.498083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:07.498365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:07.498641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:07.499354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:07.499685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:07.501270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:07.506308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 498/1007] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:07.511633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:07.520983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd0f4b-d382-4b00-aeb1-5e174925d7f2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:07.525925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:07.526563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:07.526845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:07.527120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:07.527858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] RBAC: Adding query filter params (type=image) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:07.528164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:07.529724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:07.534714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 510/1008] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:07.539872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:07.549678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a5d22-8bcc-43c3-abe9-5316b56d41c6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:07.554060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603413f-cfac-43a1-ac18-c1cf9aecb90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:07.554697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603413f-cfac-43a1-ac18-c1cf9aecb90c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:07.555036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603413f-cfac-43a1-ac18-c1cf9aecb90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:07.555318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603413f-cfac-43a1-ac18-c1cf9aecb90c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:07.556215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603413f-cfac-43a1-ac18-c1cf9aecb90c admin admin] RBAC: Adding query filter params (interface=public, service_id=1029a3a7b21f4f2ebddaba72407cf03b, region_id=RegionOne) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:07.556528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603413f-cfac-43a1-ac18-c1cf9aecb90c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:07.558103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603413f-cfac-43a1-ac18-c1cf9aecb90c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:07.563162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 499/1009] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:24:07 2022] GET /identity/v3/endpoints?service_id=1029a3a7b21f4f2ebddaba72407cf03b&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:07.568319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:07.578049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f79eb2-0d76-4c36-8bd4-d097975f0bbe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:07.582693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119be3e-a80d-4381-9642-9f6b11f951e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:07.583607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119be3e-a80d-4381-9642-9f6b11f951e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:07.584271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119be3e-a80d-4381-9642-9f6b11f951e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:07.584744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119be3e-a80d-4381-9642-9f6b11f951e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:07.585638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119be3e-a80d-4381-9642-9f6b11f951e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:07.587937 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119be3e-a80d-4381-9642-9f6b11f951e9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:07.594614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 511/1010] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:24:07 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:24:08.384532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329f33-f8bd-49d0-adfd-a5a736e461e1 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:08.384907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329f33-f8bd-49d0-adfd-a5a736e461e1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:08.385105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329f33-f8bd-49d0-adfd-a5a736e461e1 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:08.387421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 500/1011] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:08.392318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7647b3-ea07-4dfd-be2a-a90ed4e413e9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:08.392749 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7647b3-ea07-4dfd-be2a-a90ed4e413e9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:08.392910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7647b3-ea07-4dfd-be2a-a90ed4e413e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:08.411137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bd7647b3-ea07-4dfd-be2a-a90ed4e413e9 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:08.412362 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bd7647b3-ea07-4dfd-be2a-a90ed4e413e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:08.420936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 512/1012] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:08 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:08.443537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa329f33-f8bd-49d0-adfd-a5a736e461e1 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:08.455924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa329f33-f8bd-49d0-adfd-a5a736e461e1 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:08.460197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:08.460986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:08.461273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:08.461553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:08.462830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:08.464457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:08.475537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 20:24:08.476931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 501/1013] 10.222.0.60 () {56 vars in 1147 bytes} [Mon Feb 7 20:24:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:08.482690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7647b3-ea07-4dfd-be2a-a90ed4e413e9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:08.491812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7647b3-ea07-4dfd-be2a-a90ed4e413e9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:08.496381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:08.497096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:08.497446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:08.497788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:08.498573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:08.498943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:08.500633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:08.505400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 513/1014] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:08.511696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:08.526272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4aef9-46a2-43b9-bdfe-31719c27b26d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:08.530730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dca57-41bd-457b-be43-61fb17254c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:08.531658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dca57-41bd-457b-be43-61fb17254c83 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:08.531939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dca57-41bd-457b-be43-61fb17254c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:08.532212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dca57-41bd-457b-be43-61fb17254c83 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:08.532924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dca57-41bd-457b-be43-61fb17254c83 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:08.533226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dca57-41bd-457b-be43-61fb17254c83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:08.535087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dca57-41bd-457b-be43-61fb17254c83 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:08.540235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 502/1015] 10.222.0.60 () {56 vars in 1143 bytes} [Mon Feb 7 20:24:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:08.545875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:08.555411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb97a8e-2f21-4cbf-9332-32aba7f191ca admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:08.559903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ac11e-ba26-4942-912e-0772b2564289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:08.560540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac11e-ba26-4942-912e-0772b2564289 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:08.560819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac11e-ba26-4942-912e-0772b2564289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:08.561098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac11e-ba26-4942-912e-0772b2564289 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:08.561847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ac11e-ba26-4942-912e-0772b2564289 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:08.563439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ac11e-ba26-4942-912e-0772b2564289 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:08.580127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 514/1016] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:24:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:24:09.146760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fffaa-f111-4a70-8e89-e548d6dd6525 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.147108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fffaa-f111-4a70-8e89-e548d6dd6525 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.147338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fffaa-f111-4a70-8e89-e548d6dd6525 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.149781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 503/1017] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:09.154879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7a963-266d-4ca4-a4d1-d660d9f84ba2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.155264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7a963-266d-4ca4-a4d1-d660d9f84ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.155665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7a963-266d-4ca4-a4d1-d660d9f84ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.173803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-51e7a963-266d-4ca4-a4d1-d660d9f84ba2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:09.175084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-51e7a963-266d-4ca4-a4d1-d660d9f84ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:09.191711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 515/1018] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:09 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:09.216044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fffaa-f111-4a70-8e89-e548d6dd6525 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.227776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fffaa-f111-4a70-8e89-e548d6dd6525 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.232098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.232871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.233150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.233421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.234074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.235678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:09.246309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 07 20:24:09.247664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 504/1019] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:09.253528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7a963-266d-4ca4-a4d1-d660d9f84ba2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.262842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7a963-266d-4ca4-a4d1-d660d9f84ba2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.267235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.267919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.268201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.268478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.269197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:09.269501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.271089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:09.276728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 516/1020] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:24:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:09.282492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.293023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111930d-3d21-4192-a99c-f481217a5322 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.297618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad449e5-8913-4738-9c2a-940a4c85949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.298353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad449e5-8913-4738-9c2a-940a4c85949c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.298759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad449e5-8913-4738-9c2a-940a4c85949c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.299140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad449e5-8913-4738-9c2a-940a4c85949c admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.300038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad449e5-8913-4738-9c2a-940a4c85949c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:09.300449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad449e5-8913-4738-9c2a-940a4c85949c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.302158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad449e5-8913-4738-9c2a-940a4c85949c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:09.308060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 505/1021] 10.222.0.60 () {56 vars in 1133 bytes} [Mon Feb 7 20:24:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:09.312810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.322990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072e0a3-5779-42a0-b587-cbb10215f2a2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.327476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a1aef-641c-4c69-965b-706b2c0b42ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.328114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1aef-641c-4c69-965b-706b2c0b42ae admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.328393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1aef-641c-4c69-965b-706b2c0b42ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.328669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1aef-641c-4c69-965b-706b2c0b42ae admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.329427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1aef-641c-4c69-965b-706b2c0b42ae admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.330998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1aef-641c-4c69-965b-706b2c0b42ae admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:09.350701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 517/1022] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:24:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:09.801071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc0cd-2255-4409-a1b2-fff031b5ec00 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.801595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc0cd-2255-4409-a1b2-fff031b5ec00 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.801672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acc0cd-2255-4409-a1b2-fff031b5ec00 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.803563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 506/1023] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:09.809128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ca8ec-6118-4556-9cd1-98e2bbdd4560 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.809539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ca8ec-6118-4556-9cd1-98e2bbdd4560 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.809699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ca8ec-6118-4556-9cd1-98e2bbdd4560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.829604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-199ca8ec-6118-4556-9cd1-98e2bbdd4560 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:09.830806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-199ca8ec-6118-4556-9cd1-98e2bbdd4560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:09.852657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 518/1024] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:09 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:09.871128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acc0cd-2255-4409-a1b2-fff031b5ec00 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.883239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acc0cd-2255-4409-a1b2-fff031b5ec00 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.888165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.888934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.889214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.889489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.890148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.891769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:09.902326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 07 20:24:09.903743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 507/1025] 10.222.0.60 () {56 vars in 1126 bytes} [Mon Feb 7 20:24:09 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:09.909705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ca8ec-6118-4556-9cd1-98e2bbdd4560 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.918634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ca8ec-6118-4556-9cd1-98e2bbdd4560 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.923149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.923826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.924109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.924384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.925102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:09.925407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.926979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:09.932461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 519/1026] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:09.937386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.947303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8cf04-d2f5-4252-9070-a29a1d1e42b5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.951834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdba305-b219-4a6d-ad78-da701cad8640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.952470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdba305-b219-4a6d-ad78-da701cad8640 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.952752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdba305-b219-4a6d-ad78-da701cad8640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.953028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdba305-b219-4a6d-ad78-da701cad8640 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.953741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdba305-b219-4a6d-ad78-da701cad8640 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:09.954051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdba305-b219-4a6d-ad78-da701cad8640 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.955677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdba305-b219-4a6d-ad78-da701cad8640 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:09.960330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 508/1027] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:09.965274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:09.974529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c44758-f8fa-436f-a0a9-edae208e961c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:09.979604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308e2b-0878-47a8-a3b6-502d26b3291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:09.980222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308e2b-0878-47a8-a3b6-502d26b3291a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:09.980504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308e2b-0878-47a8-a3b6-502d26b3291a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:09.980779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308e2b-0878-47a8-a3b6-502d26b3291a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:09.981525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88308e2b-0878-47a8-a3b6-502d26b3291a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:09.983063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88308e2b-0878-47a8-a3b6-502d26b3291a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:10.001673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 520/1028] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:24:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:24:10.809766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba830d-329f-4069-b0e7-02ec1df78d81 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:10.810277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba830d-329f-4069-b0e7-02ec1df78d81 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:10.810354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba830d-329f-4069-b0e7-02ec1df78d81 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:10.812286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 509/1029] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:10.817540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0bf47-5566-45ac-be2e-3c102258647d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:10.817952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0bf47-5566-45ac-be2e-3c102258647d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:10.818115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0bf47-5566-45ac-be2e-3c102258647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:10.955415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0af0bf47-5566-45ac-be2e-3c102258647d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:10.956618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0af0bf47-5566-45ac-be2e-3c102258647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:10.973864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 521/1030] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:10.997989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba830d-329f-4069-b0e7-02ec1df78d81 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:11.010522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba830d-329f-4069-b0e7-02ec1df78d81 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:11.016555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de2fb8-c374-4bc2-b46b-b2fd15664dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:11.017430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de2fb8-c374-4bc2-b46b-b2fd15664dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:11.017787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de2fb8-c374-4bc2-b46b-b2fd15664dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:11.018137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de2fb8-c374-4bc2-b46b-b2fd15664dbb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:11.019419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de2fb8-c374-4bc2-b46b-b2fd15664dbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:11.021211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de2fb8-c374-4bc2-b46b-b2fd15664dbb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:11.023221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 510/1031] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:11.029046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0bf47-5566-45ac-be2e-3c102258647d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:11.038203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0bf47-5566-45ac-be2e-3c102258647d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:11.043445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d796d-1fd7-4469-af59-555e8301e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:11.044098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d796d-1fd7-4469-af59-555e8301e56d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:11.044376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d796d-1fd7-4469-af59-555e8301e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:11.044647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d796d-1fd7-4469-af59-555e8301e56d admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:11.045379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d796d-1fd7-4469-af59-555e8301e56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:11.047263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d796d-1fd7-4469-af59-555e8301e56d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:11.079019 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 522/1032] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:24:11 2022] POST /identity/v3/projects => generated 311 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:24:11.720882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4bad0-23ab-4009-9af1-6c0b24c13556 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:11.721187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4bad0-23ab-4009-9af1-6c0b24c13556 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:11.721598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4bad0-23ab-4009-9af1-6c0b24c13556 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:11.723532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 511/1033] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:11.728816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f001faf-067f-4b57-8716-8b325596a221 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:11.729179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f001faf-067f-4b57-8716-8b325596a221 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:11.729530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f001faf-067f-4b57-8716-8b325596a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:11.748351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9f001faf-067f-4b57-8716-8b325596a221 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:11.749544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9f001faf-067f-4b57-8716-8b325596a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:11.815437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 523/1034] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:11.840239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4bad0-23ab-4009-9af1-6c0b24c13556 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:11.855243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4bad0-23ab-4009-9af1-6c0b24c13556 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:11.859896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:11.860770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:11.861119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:11.861460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:11.876282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:11.884218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 20:24:11.885614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 512/1035] 10.222.0.60 () {56 vars in 1141 bytes} [Mon Feb 7 20:24:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:11.891775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f001faf-067f-4b57-8716-8b325596a221 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:11.900975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f001faf-067f-4b57-8716-8b325596a221 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:11.905671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:11.906689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:11.907046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:11.907470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:11.908327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:11.908710 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:11.910392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:11.922420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 524/1036] 10.222.0.60 () {56 vars in 1136 bytes} [Mon Feb 7 20:24:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:11.927491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:11.937935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075224e7-34e8-4091-8a20-65ff909d07f5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:11.942463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:11.943239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:11.943573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:11.943853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:11.954753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:11.956712 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:11.989539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:24:11.993408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 513/1037] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:24:11.999050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.010467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7225c-3621-452a-b370-839e2f22a94d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.016654 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.017420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.017783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.018138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.018960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:12.019341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.021080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.033709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 525/1038] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:12.040395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.050060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d196c-7547-411e-b280-078d521a1b98 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.054556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.055861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.056149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.056427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.064796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.066793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.080896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:24:12.082205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 514/1039] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:12.087948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.098677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba714b-0d7b-45c1-9f5c-f45920c94914 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.103307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.104072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.104428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.104771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.105697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:12.106080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.108043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.131122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 526/1040] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:12.132633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.143356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b107441-ebd1-4428-b921-38aeeca3d70a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.147938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.148627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.148980 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.149347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.157563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.159311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.168504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 515/1041] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:24:12.174560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.184892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559f534-93e8-4abd-861e-75d08c68bf21 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.189438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fbcde-4680-447a-84d0-6903d9b7c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.190279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbcde-4680-447a-84d0-6903d9b7c70c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.190632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbcde-4680-447a-84d0-6903d9b7c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.191072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbcde-4680-447a-84d0-6903d9b7c70c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.201828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fbcde-4680-447a-84d0-6903d9b7c70c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.203693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fbcde-4680-447a-84d0-6903d9b7c70c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.220393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9d2fbcde-4680-447a-84d0-6903d9b7c70c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:24:12.222673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 527/1042] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:24:12.228092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.236863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e07dd-746b-4036-bd10-b38ecb6a8593 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.241503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.242100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.242376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.242651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.243996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:12.244303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.245908 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.250655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83483ab-418f-43d3-b896-c86c9d94e707 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.250940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83483ab-418f-43d3-b896-c86c9d94e707 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.251232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83483ab-418f-43d3-b896-c86c9d94e707 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.253091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 528/1043] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:24:12.258950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214d43-a8cc-4631-bb0d-d6b5dd84c0bf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.259238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214d43-a8cc-4631-bb0d-d6b5dd84c0bf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.259564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214d43-a8cc-4631-bb0d-d6b5dd84c0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.260103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 516/1044] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:12.265600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.275153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d86733-e96a-476d-8ca8-a3635557ca5b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.277496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fe214d43-a8cc-4631-bb0d-d6b5dd84c0bf None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:12.278689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe214d43-a8cc-4631-bb0d-d6b5dd84c0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:12.279679 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.280454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.280742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.281269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.287055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 529/1045] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:12.288407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.290998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.304784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:24:12.312021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 517/1046] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:24:12.313515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214d43-a8cc-4631-bb0d-d6b5dd84c0bf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.313698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.322711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214d43-a8cc-4631-bb0d-d6b5dd84c0bf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.325448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ecb50-10f0-4c9a-a7d3-ce3d69b393d1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.327259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.327911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.328190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.328467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.330325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.330968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.331255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.331575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.333522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:12.333844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.335733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.337138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.338481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.351665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 518/1047] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:12.352721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 530/1048] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:24:12.353960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.356068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:12.363293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b049b-1303-4c24-bb5b-65284d7949d5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.365066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d9091-3b11-41a7-860c-6ed18bdf2b8c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:12.367844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc4257-182a-48ed-bef6-b257ca1943d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.369112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4257-182a-48ed-bef6-b257ca1943d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.369375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4257-182a-48ed-bef6-b257ca1943d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.369705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4257-182a-48ed-bef6-b257ca1943d1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.370234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9e251-0efa-45bd-ac1d-4db6a1a6f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:12.370807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc4257-182a-48ed-bef6-b257ca1943d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.370904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e251-0efa-45bd-ac1d-4db6a1a6f974 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:12.371133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e251-0efa-45bd-ac1d-4db6a1a6f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:12.371441 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9e251-0efa-45bd-ac1d-4db6a1a6f974 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:12.372280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e251-0efa-45bd-ac1d-4db6a1a6f974 admin admin] RBAC: Adding query filter params (role.id=0cf3d04cfe0647b1bef5400af66e75cf, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=097a1d32d8fe4b4ca3231950712fa579) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:12.372512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc4257-182a-48ed-bef6-b257ca1943d1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.372693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e251-0efa-45bd-ac1d-4db6a1a6f974 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:12.374173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 519/1049] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:12.374466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9e251-0efa-45bd-ac1d-4db6a1a6f974 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:12.380465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 531/1050] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:12 2022] GET /identity/v3/role_assignments?user.id=097a1d32d8fe4b4ca3231950712fa579&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=0cf3d04cfe0647b1bef5400af66e75cf => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:13.358842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d87106-8398-4527-9670-2ce5b34194c9 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:13.359370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d87106-8398-4527-9670-2ce5b34194c9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:13.359479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d87106-8398-4527-9670-2ce5b34194c9 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:13.361187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 520/1051] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:13.366507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1dfc-21f5-488a-bf28-c476787a7eb0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:13.366886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1dfc-21f5-488a-bf28-c476787a7eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:13.367080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1dfc-21f5-488a-bf28-c476787a7eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:13.385503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f23e1dfc-21f5-488a-bf28-c476787a7eb0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:13.386697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f23e1dfc-21f5-488a-bf28-c476787a7eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:13.394713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 532/1052] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:13.419848 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d87106-8398-4527-9670-2ce5b34194c9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:13.432327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d87106-8398-4527-9670-2ce5b34194c9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:13.436625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d3a0b-4b91-4cdc-8f4a-57db2275b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:13.437390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3a0b-4b91-4cdc-8f4a-57db2275b4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:13.437673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3a0b-4b91-4cdc-8f4a-57db2275b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:13.437952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3a0b-4b91-4cdc-8f4a-57db2275b4c7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:13.439123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d3a0b-4b91-4cdc-8f4a-57db2275b4c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:13.440839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d3a0b-4b91-4cdc-8f4a-57db2275b4c7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:13.442385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 521/1053] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:13.447962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1dfc-21f5-488a-bf28-c476787a7eb0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:13.456949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1dfc-21f5-488a-bf28-c476787a7eb0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:13.461951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5f3a0-eaa1-4b6c-9626-7d97edd10492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:13.462620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f3a0-eaa1-4b6c-9626-7d97edd10492 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:13.462904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f3a0-eaa1-4b6c-9626-7d97edd10492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:13.463183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f3a0-eaa1-4b6c-9626-7d97edd10492 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:13.463943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f3a0-eaa1-4b6c-9626-7d97edd10492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:13.465855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f3a0-eaa1-4b6c-9626-7d97edd10492 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:13.486814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 533/1054] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:24:13 2022] POST /identity/v3/users => generated 285 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:14.571685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6daa4-a1f3-46a5-8cde-f2774880d221 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.572211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6daa4-a1f3-46a5-8cde-f2774880d221 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.572211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6daa4-a1f3-46a5-8cde-f2774880d221 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.573975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 522/1055] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:14.579343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf28c-d9d5-473f-8b71-62c00271c28c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.579780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf28c-d9d5-473f-8b71-62c00271c28c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.579928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf28c-d9d5-473f-8b71-62c00271c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.597679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f60cf28c-d9d5-473f-8b71-62c00271c28c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:14.598849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f60cf28c-d9d5-473f-8b71-62c00271c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:14.606483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 534/1056] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:14.629525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6daa4-a1f3-46a5-8cde-f2774880d221 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.642021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6daa4-a1f3-46a5-8cde-f2774880d221 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.646261 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.647047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.647324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.647624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.659583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:14.666763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 20:24:14.667949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 523/1057] 10.222.0.60 () {56 vars in 1141 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:14.673928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cf28c-d9d5-473f-8b71-62c00271c28c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.682830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cf28c-d9d5-473f-8b71-62c00271c28c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.687282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.687971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.688252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.688529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.689292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:14.689599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.691189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:14.699544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 535/1058] 10.222.0.60 () {56 vars in 1136 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:14.704905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.714844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8d08-c8f0-43e7-afce-4aafeff15001 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.719234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.720022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.720302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.720577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.730430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.732286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:14.748376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:24:14.749489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 524/1059] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:14.754902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.764765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e7030-92ae-4ee9-a061-8de40db3261f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.769212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.769846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.770129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.770406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.771140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:14.771472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.773076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:14.789081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 536/1060] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:14.790150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.799437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e64c-ff7a-4ed1-8673-ee445610720d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.803819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.804566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.804849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.805128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.812158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.814150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:14.828036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:24:14.829075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 525/1061] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:14.834382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.844203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c902d-6f1d-4f22-8e88-b750d7c0b614 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.853082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.853761 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.854042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.854321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.855200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:14.855543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.857370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:14.874627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 537/1062] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:14.879994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.890028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81848bfa-7743-494b-9504-e7360fdf2f2a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.894419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.895240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.895594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.895876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.905717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.907824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:14.923974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:24:14.925084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 526/1063] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:14.930977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.940437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56db7d-ad97-46fd-9ea4-0d276ce6dbb9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.944882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.945522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.945803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.946682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.947447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:14.947759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.949345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:14.960335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 538/1064] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:14.965461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:14.974770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0492c77-591f-4ad3-a835-0953df69fcc8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:14.980918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:14.981689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:14.981973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:14.982250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:14.989053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:14.990996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:15.004107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:24:15.005239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 527/1065] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:15.011452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:15.020883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8c9c0-a8cb-44d7-a130-1ab143b19593 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:15.025326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe728d-7f28-4452-bbf8-62a717d562eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:15.025968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe728d-7f28-4452-bbf8-62a717d562eb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.026252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe728d-7f28-4452-bbf8-62a717d562eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.026532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe728d-7f28-4452-bbf8-62a717d562eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.027328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe728d-7f28-4452-bbf8-62a717d562eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:15.027678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe728d-7f28-4452-bbf8-62a717d562eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:15.029519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe728d-7f28-4452-bbf8-62a717d562eb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:15.042731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 539/1066] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:24:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:15.048375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:15.059172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4a35b-b2b5-4046-92d1-1592bdd11c34 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:15.063923 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875db6e-c9fd-46b3-ab94-ba1264ec3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:15.064793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875db6e-c9fd-46b3-ab94-ba1264ec3cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.065075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875db6e-c9fd-46b3-ab94-ba1264ec3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.065351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875db6e-c9fd-46b3-ab94-ba1264ec3cb7 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/097a1d32d8fe4b4ca3231950712fa579/roles/0cf3d04cfe0647b1bef5400af66e75cf` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.067584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875db6e-c9fd-46b3-ab94-ba1264ec3cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=097a1d32d8fe4b4ca3231950712fa579, role_id=0cf3d04cfe0647b1bef5400af66e75cf)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:15.070217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875db6e-c9fd-46b3-ab94-ba1264ec3cb7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:15.083674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 528/1067] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:24:15 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/097a1d32d8fe4b4ca3231950712fa579/roles/0cf3d04cfe0647b1bef5400af66e75cf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:24:15.742483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5855b-4cb6-4097-838c-5678d0762be2 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.743659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5855b-4cb6-4097-838c-5678d0762be2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.743659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5855b-4cb6-4097-838c-5678d0762be2 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.745316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 540/1068] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:15.750795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c068b-1aac-48f8-a2f1-8215f7b5d154 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.751233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c068b-1aac-48f8-a2f1-8215f7b5d154 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.751359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c068b-1aac-48f8-a2f1-8215f7b5d154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.769128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-cc1c068b-1aac-48f8-a2f1-8215f7b5d154 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:15.770300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cc1c068b-1aac-48f8-a2f1-8215f7b5d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:15.825599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 529/1069] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:15.849119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5855b-4cb6-4097-838c-5678d0762be2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:15.861654 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5855b-4cb6-4097-838c-5678d0762be2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:15.866043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:15.866817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.867103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.867384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.878089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:15.885596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:15.886790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 541/1070] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:15.892852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c068b-1aac-48f8-a2f1-8215f7b5d154 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:15.901694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c068b-1aac-48f8-a2f1-8215f7b5d154 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:15.906456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:15.907105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.907401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.907689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.908446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:15.908753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:15.910348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:15.918284 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 530/1071] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:15.924108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:15.934165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744719d9-bfef-4e5d-9689-0c23ff409ffd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:15.943880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:15.943880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.943880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.943880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] PATH_INFO: `/v3/users/57e87eeda6b04c29aae7cd9f3e7564b5` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.958846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] RBAC: Authorizing `identity:get_user(user_id=57e87eeda6b04c29aae7cd9f3e7564b5)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:15.961030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:15.962736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 542/1072] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:15 2022] GET /identity/v3/users/57e87eeda6b04c29aae7cd9f3e7564b5 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:15.968696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:15.978966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47407ac8-4825-4d02-897e-cea12c0866c7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:15.983590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:15.984287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:15.984636 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:15.984981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:15.993370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:15.995131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:16.004075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 531/1073] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:15 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:16.009650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:16.019349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c324f-331c-4fec-85d3-7fef407232fa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:16.023881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93d9a6-473f-411d-8cc6-6d9fa41769b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:16.024719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d9a6-473f-411d-8cc6-6d9fa41769b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:16.025009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d9a6-473f-411d-8cc6-6d9fa41769b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:16.025288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93d9a6-473f-411d-8cc6-6d9fa41769b5 admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:16.026470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93d9a6-473f-411d-8cc6-6d9fa41769b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=49456d107bc94f06aa38f918b382ade7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:16.028562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93d9a6-473f-411d-8cc6-6d9fa41769b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:16.030201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 543/1074] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:16 2022] GET /identity/v3/projects/49456d107bc94f06aa38f918b382ade7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:16.036190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:16.045498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf844f-31cc-48fe-94d5-bc72114b9065 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:16.050031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cb05-89d6-40ed-b833-03cb5f615a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:16.050663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cb05-89d6-40ed-b833-03cb5f615a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:16.050954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cb05-89d6-40ed-b833-03cb5f615a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:16.051234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cb05-89d6-40ed-b833-03cb5f615a3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:16.052098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4cb05-89d6-40ed-b833-03cb5f615a3e admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=49456d107bc94f06aa38f918b382ade7, user.id=57e87eeda6b04c29aae7cd9f3e7564b5) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:16.052415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4cb05-89d6-40ed-b833-03cb5f615a3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:16.054248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4cb05-89d6-40ed-b833-03cb5f615a3e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:16.060368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 532/1075] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:16 2022] GET /identity/v3/role_assignments?user.id=57e87eeda6b04c29aae7cd9f3e7564b5&scope.project.id=49456d107bc94f06aa38f918b382ade7&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:17.264044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce82c3-700d-48df-881c-424df0bca63f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.264600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce82c3-700d-48df-881c-424df0bca63f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.264600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce82c3-700d-48df-881c-424df0bca63f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.266472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 544/1076] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:17.271720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372c10-eb88-4d33-8235-bd6ba4e1d544 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.272115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372c10-eb88-4d33-8235-bd6ba4e1d544 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.272279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d372c10-eb88-4d33-8235-bd6ba4e1d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.289700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0d372c10-eb88-4d33-8235-bd6ba4e1d544 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:17.290865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0d372c10-eb88-4d33-8235-bd6ba4e1d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:17.298386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 533/1077] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:17.322658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce82c3-700d-48df-881c-424df0bca63f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.334581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce82c3-700d-48df-881c-424df0bca63f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.338942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.339748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.340028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.340302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.350189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:17.357338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 20:24:17.358470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 545/1078] 10.222.0.60 () {56 vars in 1141 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:17.363855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372c10-eb88-4d33-8235-bd6ba4e1d544 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.373074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d372c10-eb88-4d33-8235-bd6ba4e1d544 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.377504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.378152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.378437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.378716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.379500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:17.379812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.381398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.389659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 534/1079] 10.222.0.60 () {56 vars in 1136 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:17.394856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.404223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa317fb-db69-4bb2-a3db-e29735af964c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.409072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.409809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.410087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.410360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.420683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.422485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.438406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:24:17.439535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 546/1080] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:17.444853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.454884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee840-0ec1-4d4a-97c6-d1206e04d5d5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.459523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.460254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.460607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.460954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.461754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:17.462132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.463814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.479771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 535/1081] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:17.480874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.490203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c332-0062-4c6d-8a36-b33b6ab0fafa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.495300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.496083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.496364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.496637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.504304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.506270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.519700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 20:24:17.520759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 547/1082] 10.222.0.60 () {56 vars in 1114 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:17.526897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.536733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66d729-647e-4a69-86e1-758421860ffe admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.541315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.542034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.542386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.542731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.543677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:17.543991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.545833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.563367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 536/1083] 10.222.0.60 () {56 vars in 1154 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:17.568822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.578881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8974-b899-4aa2-8b69-34cb5f15e4b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.583317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.583982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.584263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.584561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.592787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.594575 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.603427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 548/1084] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:17.608913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.618471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e564252-30ef-4c76-b885-a9bca0719b18 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.622880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.623680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.623963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.624236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.634599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.636443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.653127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:24:17.654280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 537/1085] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:24:17.660266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.669146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef523-e0b7-4126-aee8-8223b5e1cfd8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.673676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.674319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.674601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.674879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.675639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:17.675948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.677535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.689342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 549/1086] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:17.694775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.704836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e9fef-33e4-49e8-b1c8-13615c3bf42a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.709255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.710025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.710308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.710585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.717952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.719927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.732514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:24:17.733640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 538/1087] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:17.739332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.748900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd2bbf-6483-48d5-a313-eae48c1dd907 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.753413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e526e-a98c-4f3e-886c-9285303d8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.754051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e526e-a98c-4f3e-886c-9285303d8b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.754329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e526e-a98c-4f3e-886c-9285303d8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.754602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e526e-a98c-4f3e-886c-9285303d8b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.755418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e526e-a98c-4f3e-886c-9285303d8b84 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:17.755730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e526e-a98c-4f3e-886c-9285303d8b84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.757560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e526e-a98c-4f3e-886c-9285303d8b84 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.769287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 550/1088] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:17.776328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:17.786623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df4f7f-7895-483b-986c-13161b271d0c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:17.791097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4d344-d7b6-4edd-8ce2-fb7f0ca51b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:17.791766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d344-d7b6-4edd-8ce2-fb7f0ca51b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:17.792048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d344-d7b6-4edd-8ce2-fb7f0ca51b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:17.792322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4d344-d7b6-4edd-8ce2-fb7f0ca51b3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:17.793147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4d344-d7b6-4edd-8ce2-fb7f0ca51b3e admin admin] RBAC: Adding query filter params (role.id=0cf3d04cfe0647b1bef5400af66e75cf, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=097a1d32d8fe4b4ca3231950712fa579) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:17.793456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4d344-d7b6-4edd-8ce2-fb7f0ca51b3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:17.795273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4d344-d7b6-4edd-8ce2-fb7f0ca51b3e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:17.801015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 539/1089] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:17 2022] GET /identity/v3/role_assignments?user.id=097a1d32d8fe4b4ca3231950712fa579&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=0cf3d04cfe0647b1bef5400af66e75cf => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:18.231894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9673b-5e5e-426a-bdad-a691fa07e29d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:18.232169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9673b-5e5e-426a-bdad-a691fa07e29d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:18.232459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9673b-5e5e-426a-bdad-a691fa07e29d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:18.234247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 551/1090] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:18.239774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69491-2840-42ad-bc57-4218fab4a985 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:18.240141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69491-2840-42ad-bc57-4218fab4a985 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:18.240494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69491-2840-42ad-bc57-4218fab4a985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:18.258895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d8d69491-2840-42ad-bc57-4218fab4a985 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:18.260094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d8d69491-2840-42ad-bc57-4218fab4a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:18.267736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 540/1091] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:18.291052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9673b-5e5e-426a-bdad-a691fa07e29d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:18.303381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9673b-5e5e-426a-bdad-a691fa07e29d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:18.308356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:18.309131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:18.309408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:18.309687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:18.320102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:18.326852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:18.328245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 552/1092] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:24:18.334191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d69491-2840-42ad-bc57-4218fab4a985 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:18.343945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d69491-2840-42ad-bc57-4218fab4a985 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:18.348429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:18.349080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:18.349358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:18.349627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:18.350387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:18.350688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:18.352857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:18.361138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 541/1093] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:18.367099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:18.378141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2202b5-ecba-47ff-a7c3-2f50f181afb3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:18.382853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:18.383807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:18.384091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:18.384369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] PATH_INFO: `/v3/users/57e87eeda6b04c29aae7cd9f3e7564b5` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:18.385614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] RBAC: Authorizing `identity:get_user(user_id=57e87eeda6b04c29aae7cd9f3e7564b5)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:18.387774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:18.390449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 553/1094] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:18 2022] GET /identity/v3/users/57e87eeda6b04c29aae7cd9f3e7564b5 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:18.394984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:18.404807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbff3b-ca2a-4bbf-89a8-16caa788e91e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:18.409641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63d7b0-f1d6-480c-a2ff-e51a769c4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:18.410483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d7b0-f1d6-480c-a2ff-e51a769c4f4d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:18.410772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d7b0-f1d6-480c-a2ff-e51a769c4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:18.411054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d7b0-f1d6-480c-a2ff-e51a769c4f4d admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:18.412296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63d7b0-f1d6-480c-a2ff-e51a769c4f4d admin admin] RBAC: Authorizing `identity:get_project(project_id=49456d107bc94f06aa38f918b382ade7)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:18.414334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63d7b0-f1d6-480c-a2ff-e51a769c4f4d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:18.416634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 542/1095] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:18 2022] GET /identity/v3/projects/49456d107bc94f06aa38f918b382ade7 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:18.424346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:18.434804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77dea3-a178-4f29-85d7-5873a3b96149 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:18.439338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d19b8-3ea9-4355-9d6d-b9ec2d621e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:18.440244 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d19b8-3ea9-4355-9d6d-b9ec2d621e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:18.440529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d19b8-3ea9-4355-9d6d-b9ec2d621e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:18.440810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d19b8-3ea9-4355-9d6d-b9ec2d621e22 admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7/users/57e87eeda6b04c29aae7cd9f3e7564b5/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:18.442816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d19b8-3ea9-4355-9d6d-b9ec2d621e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49456d107bc94f06aa38f918b382ade7, user_id=57e87eeda6b04c29aae7cd9f3e7564b5, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:18.445489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d19b8-3ea9-4355-9d6d-b9ec2d621e22 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:18.461418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 554/1096] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:24:18 2022] PUT /identity/v3/projects/49456d107bc94f06aa38f918b382ade7/users/57e87eeda6b04c29aae7cd9f3e7564b5/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:24:20.661590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26b43-8800-4740-aa3d-5ac21170b24c None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.662139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26b43-8800-4740-aa3d-5ac21170b24c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.662139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26b43-8800-4740-aa3d-5ac21170b24c None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.663942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 543/1097] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:20.669203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89866c20-3eb4-4419-8d7a-9a66ed0bb161 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.669586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89866c20-3eb4-4419-8d7a-9a66ed0bb161 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.669754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89866c20-3eb4-4419-8d7a-9a66ed0bb161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.686723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-89866c20-3eb4-4419-8d7a-9a66ed0bb161 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:20.687919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-89866c20-3eb4-4419-8d7a-9a66ed0bb161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:20.742100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 555/1098] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:20.765647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26b43-8800-4740-aa3d-5ac21170b24c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:20.778014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26b43-8800-4740-aa3d-5ac21170b24c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:20.782557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:20.783321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.783631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.783906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.793771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:20.800464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:20.801611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 544/1099] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:20.807010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89866c20-3eb4-4419-8d7a-9a66ed0bb161 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:20.815739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89866c20-3eb4-4419-8d7a-9a66ed0bb161 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:20.820190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:20.821322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.821604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.821884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.822640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:20.822949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:20.824583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:20.832552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 556/1100] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:20.838327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:20.847937 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480c6fe-b37d-4c96-8aad-9b41717f3d28 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:20.852552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:20.853378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.853658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.853936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] PATH_INFO: `/v3/users/57e87eeda6b04c29aae7cd9f3e7564b5` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.855153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] RBAC: Authorizing `identity:get_user(user_id=57e87eeda6b04c29aae7cd9f3e7564b5)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:20.857301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:20.858839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 545/1101] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:20 2022] GET /identity/v3/users/57e87eeda6b04c29aae7cd9f3e7564b5 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:20.864070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:20.874094 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dfb43-1900-48d8-96a8-1f4bfb4b3d96 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:20.878585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:20.879211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.879547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.879832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.888039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:20.889898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:20.898568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 557/1102] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:24:20.904140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:20.913791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879a656-6bdd-447b-b8b5-1770db040fdb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:20.918207 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f46c9f-20f9-4046-b4d8-07e283b1b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:20.919021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46c9f-20f9-4046-b4d8-07e283b1b657 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.919301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46c9f-20f9-4046-b4d8-07e283b1b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.919608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f46c9f-20f9-4046-b4d8-07e283b1b657 admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.920763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f46c9f-20f9-4046-b4d8-07e283b1b657 admin admin] RBAC: Authorizing `identity:get_project(project_id=49456d107bc94f06aa38f918b382ade7)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:20.922777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f46c9f-20f9-4046-b4d8-07e283b1b657 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:20.924407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 546/1103] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:20 2022] GET /identity/v3/projects/49456d107bc94f06aa38f918b382ade7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:20.929779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:20.938675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d6c41-7961-41fc-99e2-176ac52a013e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:20.943179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c9e20-ec1d-477b-89ac-0cdeb8f31ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:20.943821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9e20-ec1d-477b-89ac-0cdeb8f31ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:20.944107 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9e20-ec1d-477b-89ac-0cdeb8f31ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:20.944385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9e20-ec1d-477b-89ac-0cdeb8f31ed5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:20.945213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c9e20-ec1d-477b-89ac-0cdeb8f31ed5 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=49456d107bc94f06aa38f918b382ade7, user.id=57e87eeda6b04c29aae7cd9f3e7564b5) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:20.945526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c9e20-ec1d-477b-89ac-0cdeb8f31ed5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:20.947878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c9e20-ec1d-477b-89ac-0cdeb8f31ed5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:20.953414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 558/1104] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:20 2022] GET /identity/v3/role_assignments?user.id=57e87eeda6b04c29aae7cd9f3e7564b5&scope.project.id=49456d107bc94f06aa38f918b382ade7&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:23.160544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ab054-79ac-4fdc-b990-28b62090f17a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:23.161090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ab054-79ac-4fdc-b990-28b62090f17a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:23.161090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ab054-79ac-4fdc-b990-28b62090f17a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:23.162839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 547/1105] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:23.168102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab628bd-432a-4717-83cb-bfb8b1579c7c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:23.168536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab628bd-432a-4717-83cb-bfb8b1579c7c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:23.168672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab628bd-432a-4717-83cb-bfb8b1579c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:23.186674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-eab628bd-432a-4717-83cb-bfb8b1579c7c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:23.187890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-eab628bd-432a-4717-83cb-bfb8b1579c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:23.195564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 559/1106] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:23.228263 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ab054-79ac-4fdc-b990-28b62090f17a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:23.240047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ab054-79ac-4fdc-b990-28b62090f17a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:23.244810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdeda9-1528-4715-99b2-0b67deeefe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:23.245569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdeda9-1528-4715-99b2-0b67deeefe0a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:23.245852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdeda9-1528-4715-99b2-0b67deeefe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:23.246130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdeda9-1528-4715-99b2-0b67deeefe0a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:23.247285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdeda9-1528-4715-99b2-0b67deeefe0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:23.248983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdeda9-1528-4715-99b2-0b67deeefe0a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:23.250513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 548/1107] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:23.255671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab628bd-432a-4717-83cb-bfb8b1579c7c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:23.264895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab628bd-432a-4717-83cb-bfb8b1579c7c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:23.269306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9444334-dddf-4468-96c5-aef4f09645e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:23.269944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444334-dddf-4468-96c5-aef4f09645e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:23.270224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444334-dddf-4468-96c5-aef4f09645e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:23.270499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444334-dddf-4468-96c5-aef4f09645e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:23.271217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9444334-dddf-4468-96c5-aef4f09645e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:23.273163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9444334-dddf-4468-96c5-aef4f09645e6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:23.292703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 560/1108] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:24:23 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:24:25.494395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54abdf-634c-4ada-8ca3-855ae068af03 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:25.494922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54abdf-634c-4ada-8ca3-855ae068af03 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:25.494922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54abdf-634c-4ada-8ca3-855ae068af03 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:25.496730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 549/1109] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:25.501872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354da0-85ff-4393-8353-3ef15a00a284 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:25.502288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354da0-85ff-4393-8353-3ef15a00a284 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:25.502428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354da0-85ff-4393-8353-3ef15a00a284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:25.520254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-04354da0-85ff-4393-8353-3ef15a00a284 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:25.521415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-04354da0-85ff-4393-8353-3ef15a00a284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:25.529117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 561/1110] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:25.552220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54abdf-634c-4ada-8ca3-855ae068af03 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:25.564492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54abdf-634c-4ada-8ca3-855ae068af03 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:25.568761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:25.569575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:25.569857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:25.570131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] PATH_INFO: `/v3/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:25.572251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] RBAC: Authorizing `identity:get_role(role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:25.573270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:24:25.573270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:24:25.573270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:24:25.574145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:25.575433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 550/1111] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:25 2022] GET /identity/v3/roles/a72109d329f74a0b9917f5b6b41a425d => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:25.580491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04354da0-85ff-4393-8353-3ef15a00a284 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:25.588995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04354da0-85ff-4393-8353-3ef15a00a284 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:25.593500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:25.594329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:25.594606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:25.594876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] PATH_INFO: `/v3/users/c3527fd1e0e44f56a66efbfca39847a0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:25.607604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] RBAC: Authorizing `identity:get_user(user_id=c3527fd1e0e44f56a66efbfca39847a0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:25.609693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:25.611240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 562/1112] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:25 2022] GET /identity/v3/users/c3527fd1e0e44f56a66efbfca39847a0 => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:25.616387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:25.626124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba898a36-b717-4ccd-bfc9-582fb906455f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:25.630543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:25.631153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:25.631465 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:25.631744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:25.639884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:25.641585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:25.650093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 551/1113] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:25 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:25.655840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:25.665235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe3ea-aee9-4a53-8b7c-2edcd32317bd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:25.669650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820b917-b00e-421f-9a1d-0b2c9e4722c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:25.670460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820b917-b00e-421f-9a1d-0b2c9e4722c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:25.670736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820b917-b00e-421f-9a1d-0b2c9e4722c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:25.671008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820b917-b00e-421f-9a1d-0b2c9e4722c5 admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:25.672188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820b917-b00e-421f-9a1d-0b2c9e4722c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=49456d107bc94f06aa38f918b382ade7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:25.674213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820b917-b00e-421f-9a1d-0b2c9e4722c5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:25.675832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 563/1114] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:25 2022] GET /identity/v3/projects/49456d107bc94f06aa38f918b382ade7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:25.681599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:25.689952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac4aa-cb14-4489-9626-eec61396504a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:25.694359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec60e-93a1-4a01-a140-a4708f0c7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:25.694960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec60e-93a1-4a01-a140-a4708f0c7cab admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:25.695237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec60e-93a1-4a01-a140-a4708f0c7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:25.696147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec60e-93a1-4a01-a140-a4708f0c7cab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:25.696966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec60e-93a1-4a01-a140-a4708f0c7cab admin admin] RBAC: Adding query filter params (role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=49456d107bc94f06aa38f918b382ade7, user.id=c3527fd1e0e44f56a66efbfca39847a0) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:25.697272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec60e-93a1-4a01-a140-a4708f0c7cab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:25.699059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec60e-93a1-4a01-a140-a4708f0c7cab admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:25.704175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 552/1115] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:25 2022] GET /identity/v3/role_assignments?user.id=c3527fd1e0e44f56a66efbfca39847a0&scope.project.id=49456d107bc94f06aa38f918b382ade7&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:27.854184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e953906-ba84-40bf-a431-7daa17560d2e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:27.854703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e953906-ba84-40bf-a431-7daa17560d2e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:27.854796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e953906-ba84-40bf-a431-7daa17560d2e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:27.856521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 564/1116] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:27.861522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38597506-b4e1-490b-978c-c88222ae2080 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:27.861901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38597506-b4e1-490b-978c-c88222ae2080 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:27.862064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38597506-b4e1-490b-978c-c88222ae2080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:27.879866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-38597506-b4e1-490b-978c-c88222ae2080 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:27.881044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-38597506-b4e1-490b-978c-c88222ae2080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:27.889214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 553/1117] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:27.911748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e953906-ba84-40bf-a431-7daa17560d2e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:27.923617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e953906-ba84-40bf-a431-7daa17560d2e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:27.927940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:27.928763 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:27.929046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:27.929324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] PATH_INFO: `/v3/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:27.931319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] RBAC: Authorizing `identity:get_role(role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:27.932370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:24:27.932370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:24:27.932370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:24:27.933239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:27.934530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 565/1118] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:27 2022] GET /identity/v3/roles/a72109d329f74a0b9917f5b6b41a425d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:27.939802 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38597506-b4e1-490b-978c-c88222ae2080 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:27.948945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38597506-b4e1-490b-978c-c88222ae2080 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:27.953342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:27.954169 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:27.954452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:27.954725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] PATH_INFO: `/v3/users/c3527fd1e0e44f56a66efbfca39847a0` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:27.955928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] RBAC: Authorizing `identity:get_user(user_id=c3527fd1e0e44f56a66efbfca39847a0)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:27.957998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:27.959526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 554/1119] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:27 2022] GET /identity/v3/users/c3527fd1e0e44f56a66efbfca39847a0 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:27.964565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:27.973629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80e537-6bb8-4e3d-8f2f-9ff216cef0f4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:27.978531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592323a-889a-4e59-9aa6-638659565784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:27.979313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592323a-889a-4e59-9aa6-638659565784 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:27.979625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592323a-889a-4e59-9aa6-638659565784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:27.979900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592323a-889a-4e59-9aa6-638659565784 admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:27.981049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592323a-889a-4e59-9aa6-638659565784 admin admin] RBAC: Authorizing `identity:get_project(project_id=49456d107bc94f06aa38f918b382ade7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:27.983020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592323a-889a-4e59-9aa6-638659565784 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:27.984631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 566/1120] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:27 2022] GET /identity/v3/projects/49456d107bc94f06aa38f918b382ade7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:27.989658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:27.999283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010db2f5-c0b2-4278-b260-dea9672ae50c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:28.003652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3bbce-b1ab-4de4-b75e-f2a8437aee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:28.004457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3bbce-b1ab-4de4-b75e-f2a8437aee6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:28.004734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3bbce-b1ab-4de4-b75e-f2a8437aee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:28.005008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3bbce-b1ab-4de4-b75e-f2a8437aee6c admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7/users/c3527fd1e0e44f56a66efbfca39847a0/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:28.007142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3bbce-b1ab-4de4-b75e-f2a8437aee6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49456d107bc94f06aa38f918b382ade7, user_id=c3527fd1e0e44f56a66efbfca39847a0, role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:28.009707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3bbce-b1ab-4de4-b75e-f2a8437aee6c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:28.021912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 555/1121] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:24:27 2022] PUT /identity/v3/projects/49456d107bc94f06aa38f918b382ade7/users/c3527fd1e0e44f56a66efbfca39847a0/roles/a72109d329f74a0b9917f5b6b41a425d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:24:30.198769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e5fe-16df-4dae-a608-df15b45fd614 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:30.199312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e5fe-16df-4dae-a608-df15b45fd614 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:30.199312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771e5fe-16df-4dae-a608-df15b45fd614 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:30.201115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 567/1122] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:24:30.206334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47788e-26d3-415e-aa6a-fd8fb36085e4 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:30.206772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47788e-26d3-415e-aa6a-fd8fb36085e4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:30.206894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47788e-26d3-415e-aa6a-fd8fb36085e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:30.224356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-da47788e-26d3-415e-aa6a-fd8fb36085e4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:30.225538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-da47788e-26d3-415e-aa6a-fd8fb36085e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:30.280547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 556/1123] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:30.304393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e5fe-16df-4dae-a608-df15b45fd614 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:30.316797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771e5fe-16df-4dae-a608-df15b45fd614 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:30.321179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:30.322007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:30.322291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:30.322601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] PATH_INFO: `/v3/roles/a72109d329f74a0b9917f5b6b41a425d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:30.324107 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] RBAC: Authorizing `identity:get_role(role_id=a72109d329f74a0b9917f5b6b41a425d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:30.325695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:30.326994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 568/1124] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:30 2022] GET /identity/v3/roles/a72109d329f74a0b9917f5b6b41a425d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:30.332222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47788e-26d3-415e-aa6a-fd8fb36085e4 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:30.340775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47788e-26d3-415e-aa6a-fd8fb36085e4 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:30.345167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:30.346003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:30.346285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:30.346563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] PATH_INFO: `/v3/users/c3527fd1e0e44f56a66efbfca39847a0` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:30.347772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] RBAC: Authorizing `identity:get_user(user_id=c3527fd1e0e44f56a66efbfca39847a0)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:30.349860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:30.351912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 557/1125] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:30 2022] GET /identity/v3/users/c3527fd1e0e44f56a66efbfca39847a0 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:30.356975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:30.365988 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed2ede-bbcd-463a-8a7e-80bfbfb98b2a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:30.370960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:30.371591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:30.371875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:30.372152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:30.379656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:30.381318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:30.389844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 569/1126] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:30.394902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:30.403975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c136-8bac-40aa-b9c4-dbff920b752d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:30.408633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf7199-0104-4d4f-972f-1f1252c6d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:30.409407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7199-0104-4d4f-972f-1f1252c6d675 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:30.409688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7199-0104-4d4f-972f-1f1252c6d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:30.409964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf7199-0104-4d4f-972f-1f1252c6d675 admin admin] PATH_INFO: `/v3/projects/49456d107bc94f06aa38f918b382ade7` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:30.411113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf7199-0104-4d4f-972f-1f1252c6d675 admin admin] RBAC: Authorizing `identity:get_project(project_id=49456d107bc94f06aa38f918b382ade7)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:30.413112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf7199-0104-4d4f-972f-1f1252c6d675 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:30.415220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 558/1127] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:30 2022] GET /identity/v3/projects/49456d107bc94f06aa38f918b382ade7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:30.420537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:30.433231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd5863-7a18-4caf-a174-3e4c31fe96d6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:30.437714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c613f9a-d253-4a4b-84f0-906b83d3fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:30.438317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613f9a-d253-4a4b-84f0-906b83d3fc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:30.438601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613f9a-d253-4a4b-84f0-906b83d3fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:30.438878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613f9a-d253-4a4b-84f0-906b83d3fc40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:30.439738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613f9a-d253-4a4b-84f0-906b83d3fc40 admin admin] RBAC: Adding query filter params (role.id=a72109d329f74a0b9917f5b6b41a425d, scope.project.id=49456d107bc94f06aa38f918b382ade7, user.id=c3527fd1e0e44f56a66efbfca39847a0) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:30.440051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613f9a-d253-4a4b-84f0-906b83d3fc40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:30.441838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613f9a-d253-4a4b-84f0-906b83d3fc40 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:30.447338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 570/1128] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:30 2022] GET /identity/v3/role_assignments?user.id=c3527fd1e0e44f56a66efbfca39847a0&scope.project.id=49456d107bc94f06aa38f918b382ade7&role.id=a72109d329f74a0b9917f5b6b41a425d => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:32.620493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454966-5354-4f8b-a208-6d397f020d2b None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:32.621026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454966-5354-4f8b-a208-6d397f020d2b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:32.621026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1454966-5354-4f8b-a208-6d397f020d2b None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:32.622820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 559/1129] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:32.628293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59df9-d3c8-4930-84a4-9e23f176197e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:32.628688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59df9-d3c8-4930-84a4-9e23f176197e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:32.628846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59df9-d3c8-4930-84a4-9e23f176197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:32.646406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d2a59df9-d3c8-4930-84a4-9e23f176197e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:32.647594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d2a59df9-d3c8-4930-84a4-9e23f176197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:32.655755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 571/1130] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:32.678840 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454966-5354-4f8b-a208-6d397f020d2b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:32.690665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1454966-5354-4f8b-a208-6d397f020d2b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:32.694924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae480dd-a171-4577-b457-c26fd3607a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:32.696222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae480dd-a171-4577-b457-c26fd3607a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:32.696506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae480dd-a171-4577-b457-c26fd3607a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:32.696784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae480dd-a171-4577-b457-c26fd3607a71 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:32.697954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae480dd-a171-4577-b457-c26fd3607a71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:32.699651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae480dd-a171-4577-b457-c26fd3607a71 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:32.701181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 560/1131] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:32.706365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a59df9-d3c8-4930-84a4-9e23f176197e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:32.715458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a59df9-d3c8-4930-84a4-9e23f176197e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:32.719874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8de1d1-0c00-40e4-83a1-c3a01c19602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:32.720497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8de1d1-0c00-40e4-83a1-c3a01c19602d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:32.720776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8de1d1-0c00-40e4-83a1-c3a01c19602d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:32.721071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8de1d1-0c00-40e4-83a1-c3a01c19602d admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:32.721787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8de1d1-0c00-40e4-83a1-c3a01c19602d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:32.723716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8de1d1-0c00-40e4-83a1-c3a01c19602d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:32.747877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 572/1132] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:24:32 2022] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:24:34.949416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1407-6ec6-416c-b9f0-56d73f2b217a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:34.949884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1407-6ec6-416c-b9f0-56d73f2b217a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:34.949973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b1407-6ec6-416c-b9f0-56d73f2b217a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:34.951728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 561/1133] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:34.956921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d38b-3df6-4ea7-8c15-7db265998ff4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:34.957287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d38b-3df6-4ea7-8c15-7db265998ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:34.957483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9d38b-3df6-4ea7-8c15-7db265998ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:34.976059 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3fb9d38b-3df6-4ea7-8c15-7db265998ff4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:34.977231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3fb9d38b-3df6-4ea7-8c15-7db265998ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:35.031945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 573/1134] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:24:35.056521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b1407-6ec6-416c-b9f0-56d73f2b217a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:35.068208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b1407-6ec6-416c-b9f0-56d73f2b217a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:35.072964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbbeab-cf12-4824-8fa2-54816052a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:35.073713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbbeab-cf12-4824-8fa2-54816052a0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:35.073988 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbbeab-cf12-4824-8fa2-54816052a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:35.074259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbbeab-cf12-4824-8fa2-54816052a0b3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:35.075430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbbeab-cf12-4824-8fa2-54816052a0b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:35.077083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbbeab-cf12-4824-8fa2-54816052a0b3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:35.078598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 562/1135] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:35.083805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9d38b-3df6-4ea7-8c15-7db265998ff4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:35.092993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9d38b-3df6-4ea7-8c15-7db265998ff4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:35.097455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74d49-1898-46a3-9ab2-fa1c416d0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:35.098090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74d49-1898-46a3-9ab2-fa1c416d0c78 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:35.098376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74d49-1898-46a3-9ab2-fa1c416d0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:35.098650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74d49-1898-46a3-9ab2-fa1c416d0c78 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:35.099372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a74d49-1898-46a3-9ab2-fa1c416d0c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:35.101279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a74d49-1898-46a3-9ab2-fa1c416d0c78 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:35.120559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 574/1136] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:24:35 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:24:37.321324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45cebb-43b9-4045-a34d-1bab28b88640 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.321867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45cebb-43b9-4045-a34d-1bab28b88640 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.321867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45cebb-43b9-4045-a34d-1bab28b88640 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.323665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 563/1137] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:37.329138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86667b-853b-4e6a-ae51-19d1258cdc3a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.329552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86667b-853b-4e6a-ae51-19d1258cdc3a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.329696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86667b-853b-4e6a-ae51-19d1258cdc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.347383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-aa86667b-853b-4e6a-ae51-19d1258cdc3a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:37.348572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-aa86667b-853b-4e6a-ae51-19d1258cdc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:37.356062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 575/1138] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:37.379639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45cebb-43b9-4045-a34d-1bab28b88640 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:37.392075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45cebb-43b9-4045-a34d-1bab28b88640 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:37.396371 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:37.397128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.397408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.397683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.407804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:37.414481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:37.415625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 564/1139] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:37.420963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86667b-853b-4e6a-ae51-19d1258cdc3a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:37.430025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86667b-853b-4e6a-ae51-19d1258cdc3a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:37.434394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:37.435022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.435299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.435604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.436358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:37.436660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:37.438240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:37.446664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 576/1140] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:37.452363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:37.462027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b20386-b9cf-4778-a3de-c16b94af30d9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:37.466437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:37.467241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.467564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.467845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] PATH_INFO: `/v3/users/d832bcbe4fba40d98a0dfb6147c2111f` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.480309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] RBAC: Authorizing `identity:get_user(user_id=d832bcbe4fba40d98a0dfb6147c2111f)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:37.482409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:37.483991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 565/1141] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:37 2022] GET /identity/v3/users/d832bcbe4fba40d98a0dfb6147c2111f => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:37.489165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:37.498984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083415cf-b00e-4a4e-91e2-1d7bc58e44e3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:37.503497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:37.504111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.504396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.504675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.512904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:37.514641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:37.523364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 577/1142] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:37 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:37.528641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:37.538262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae881c8-8959-4a6f-8a03-30e09edd5003 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:37.542717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0352c-7c8c-40bc-9230-ac72ada20e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:37.543568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0352c-7c8c-40bc-9230-ac72ada20e63 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.543851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0352c-7c8c-40bc-9230-ac72ada20e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.544127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0352c-7c8c-40bc-9230-ac72ada20e63 admin admin] PATH_INFO: `/v3/projects/9a6d2d00051b43ad9305387854839b29` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.545288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0352c-7c8c-40bc-9230-ac72ada20e63 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a6d2d00051b43ad9305387854839b29)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:37.547277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0352c-7c8c-40bc-9230-ac72ada20e63 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:37.549028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 566/1143] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:37 2022] GET /identity/v3/projects/9a6d2d00051b43ad9305387854839b29 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:37.554629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:37.562846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305026ad-441b-4756-a083-c3b5f37f766a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:37.567239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902418b-83aa-4c6d-bd68-7012f4e8b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:37.567874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902418b-83aa-4c6d-bd68-7012f4e8b8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:37.568156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902418b-83aa-4c6d-bd68-7012f4e8b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:37.568432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902418b-83aa-4c6d-bd68-7012f4e8b8ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:37.569249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902418b-83aa-4c6d-bd68-7012f4e8b8ff admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=9a6d2d00051b43ad9305387854839b29, user.id=d832bcbe4fba40d98a0dfb6147c2111f) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:37.569558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902418b-83aa-4c6d-bd68-7012f4e8b8ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:37.572061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902418b-83aa-4c6d-bd68-7012f4e8b8ff admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:37.577056 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 578/1144] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:37 2022] GET /identity/v3/role_assignments?user.id=d832bcbe4fba40d98a0dfb6147c2111f&scope.project.id=9a6d2d00051b43ad9305387854839b29&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:39.762113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37fa7f-b9d0-4e48-ad34-a2558e1c1a43 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:39.764153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37fa7f-b9d0-4e48-ad34-a2558e1c1a43 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:39.764153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37fa7f-b9d0-4e48-ad34-a2558e1c1a43 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:39.764609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 567/1145] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:39.769776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd30aa-323d-40ed-819c-a516e56573ea None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:39.770220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd30aa-323d-40ed-819c-a516e56573ea None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:39.770343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd30aa-323d-40ed-819c-a516e56573ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:39.788310 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-57dd30aa-323d-40ed-819c-a516e56573ea None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:39.790078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-57dd30aa-323d-40ed-819c-a516e56573ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:39.797659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 579/1146] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:39.819979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37fa7f-b9d0-4e48-ad34-a2558e1c1a43 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:39.831759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37fa7f-b9d0-4e48-ad34-a2558e1c1a43 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:39.836520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:39.837267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:39.837544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:39.837817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:39.847570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:39.854793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:39.855982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 568/1147] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:39.861612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd30aa-323d-40ed-819c-a516e56573ea None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:39.870444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd30aa-323d-40ed-819c-a516e56573ea None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:39.874964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:39.875643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:39.875926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:39.876203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:39.876966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:39.877276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:39.878858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:39.886899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 580/1148] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:39.893132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:39.903617 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04a9b-2f22-4504-840c-586537e518ea admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:39.908321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:39.909150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:39.909429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:39.909704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] PATH_INFO: `/v3/users/d832bcbe4fba40d98a0dfb6147c2111f` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:39.910885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] RBAC: Authorizing `identity:get_user(user_id=d832bcbe4fba40d98a0dfb6147c2111f)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:39.913025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:39.915221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 569/1149] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:39 2022] GET /identity/v3/users/d832bcbe4fba40d98a0dfb6147c2111f => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:39.920439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:39.929776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434235-45b6-4569-aa3a-85f0d7408c78 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:39.934181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a6b4-6fd4-47bc-ae45-492863829287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:39.934997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a6b4-6fd4-47bc-ae45-492863829287 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:39.935280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a6b4-6fd4-47bc-ae45-492863829287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:39.935590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a6b4-6fd4-47bc-ae45-492863829287 admin admin] PATH_INFO: `/v3/projects/9a6d2d00051b43ad9305387854839b29` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:39.936768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052a6b4-6fd4-47bc-ae45-492863829287 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a6d2d00051b43ad9305387854839b29)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:39.938776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052a6b4-6fd4-47bc-ae45-492863829287 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:39.940415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 581/1150] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:39 2022] GET /identity/v3/projects/9a6d2d00051b43ad9305387854839b29 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:39.946109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:39.955129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910f17-0292-47c2-9b19-4be0dc65f8ce admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:39.959497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e4a8-e054-412a-8ed6-d060c27d458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:39.960307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e4a8-e054-412a-8ed6-d060c27d458f admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:39.961184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e4a8-e054-412a-8ed6-d060c27d458f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:39.961459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e4a8-e054-412a-8ed6-d060c27d458f admin admin] PATH_INFO: `/v3/projects/9a6d2d00051b43ad9305387854839b29/users/d832bcbe4fba40d98a0dfb6147c2111f/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:39.963351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e4a8-e054-412a-8ed6-d060c27d458f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6d2d00051b43ad9305387854839b29, user_id=d832bcbe4fba40d98a0dfb6147c2111f, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:39.965921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e4a8-e054-412a-8ed6-d060c27d458f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:39.978156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 570/1151] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:24:39 2022] PUT /identity/v3/projects/9a6d2d00051b43ad9305387854839b29/users/d832bcbe4fba40d98a0dfb6147c2111f/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:24:42.123346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17def54c-71ad-4493-b2d7-644e01c6b98e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.123893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17def54c-71ad-4493-b2d7-644e01c6b98e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.123893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17def54c-71ad-4493-b2d7-644e01c6b98e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.125610 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 582/1152] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:42.130829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095d40d-2457-4f53-8310-edf1e7c5362a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.131264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095d40d-2457-4f53-8310-edf1e7c5362a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.131533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095d40d-2457-4f53-8310-edf1e7c5362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.149082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d095d40d-2457-4f53-8310-edf1e7c5362a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:42.150255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d095d40d-2457-4f53-8310-edf1e7c5362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:42.204516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 571/1153] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:42.228369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17def54c-71ad-4493-b2d7-644e01c6b98e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:42.240162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17def54c-71ad-4493-b2d7-644e01c6b98e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:42.244428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:42.245180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.245457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.245729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.255580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:42.262778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:42.263946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 583/1154] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:42.269411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095d40d-2457-4f53-8310-edf1e7c5362a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:42.278671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095d40d-2457-4f53-8310-edf1e7c5362a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:42.283338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:42.284005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.284287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.284565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.285317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:42.285624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:42.287213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:42.295180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 572/1155] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:42.302258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:42.314178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b24fc-2f97-4756-8683-3e3aa5aa3081 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:42.318723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:42.320099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.320381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.320661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] PATH_INFO: `/v3/users/d832bcbe4fba40d98a0dfb6147c2111f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.321867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] RBAC: Authorizing `identity:get_user(user_id=d832bcbe4fba40d98a0dfb6147c2111f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:42.324013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:42.325577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 584/1156] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:42 2022] GET /identity/v3/users/d832bcbe4fba40d98a0dfb6147c2111f => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:42.330804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:42.340756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba41b2-cb59-4b86-8270-b69827965d3b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:42.345306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:42.345916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.346198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.346476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.353987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:42.355864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:42.364360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 573/1157] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:42 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:42.369557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:42.378814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428d4f2-e26e-461a-97da-24c0964e66aa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:42.383735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6a3bb-064c-4e58-8c11-34fac14a301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:42.384539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6a3bb-064c-4e58-8c11-34fac14a301f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.384822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6a3bb-064c-4e58-8c11-34fac14a301f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.385101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6a3bb-064c-4e58-8c11-34fac14a301f admin admin] PATH_INFO: `/v3/projects/9a6d2d00051b43ad9305387854839b29` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.386264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6a3bb-064c-4e58-8c11-34fac14a301f admin admin] RBAC: Authorizing `identity:get_project(project_id=9a6d2d00051b43ad9305387854839b29)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:42.388308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6a3bb-064c-4e58-8c11-34fac14a301f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:42.389912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 585/1158] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:42 2022] GET /identity/v3/projects/9a6d2d00051b43ad9305387854839b29 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:42.395162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:42.404403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306779-12ea-4786-bc92-d441426e3bb6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:42.409156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb0778-36e2-4f98-b495-35c85d87fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:42.409778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb0778-36e2-4f98-b495-35c85d87fcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:42.410061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb0778-36e2-4f98-b495-35c85d87fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:42.410339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb0778-36e2-4f98-b495-35c85d87fcb6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:42.411170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb0778-36e2-4f98-b495-35c85d87fcb6 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=9a6d2d00051b43ad9305387854839b29, user.id=d832bcbe4fba40d98a0dfb6147c2111f) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:42.411515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb0778-36e2-4f98-b495-35c85d87fcb6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:42.413333 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb0778-36e2-4f98-b495-35c85d87fcb6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:42.418900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 574/1159] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:42 2022] GET /identity/v3/role_assignments?user.id=d832bcbe4fba40d98a0dfb6147c2111f&scope.project.id=9a6d2d00051b43ad9305387854839b29&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:44.610845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6971-2f78-4738-b69d-22066ce009b9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:44.611414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6971-2f78-4738-b69d-22066ce009b9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:44.611414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6971-2f78-4738-b69d-22066ce009b9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:44.613203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 586/1160] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:44.618969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa012d35-71d4-4107-a2e7-496496b3f062 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:44.619415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa012d35-71d4-4107-a2e7-496496b3f062 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:44.619560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa012d35-71d4-4107-a2e7-496496b3f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:44.637187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-aa012d35-71d4-4107-a2e7-496496b3f062 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:44.638358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-aa012d35-71d4-4107-a2e7-496496b3f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:44.645852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 575/1161] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:44.668509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6971-2f78-4738-b69d-22066ce009b9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:44.680987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6971-2f78-4738-b69d-22066ce009b9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:44.685212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:44.685824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:44.686101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:44.686376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:44.693780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:44.695535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:44.704058 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 587/1162] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:44.709434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa012d35-71d4-4107-a2e7-496496b3f062 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:44.718041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa012d35-71d4-4107-a2e7-496496b3f062 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:44.722416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780a22-b185-4cfe-b722-344bf121d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:44.723177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780a22-b185-4cfe-b722-344bf121d091 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:44.723496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780a22-b185-4cfe-b722-344bf121d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:44.723775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780a22-b185-4cfe-b722-344bf121d091 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:44.730937 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05780a22-b185-4cfe-b722-344bf121d091 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:44.732777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05780a22-b185-4cfe-b722-344bf121d091 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:44.747012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-05780a22-b185-4cfe-b722-344bf121d091 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 07 20:24:44.748137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 576/1163] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:24:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:44.753578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:44.762002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1235e-704d-497b-bf44-cff83d1ccf5e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:44.766396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08e55a-ec86-4def-9b56-c36389583246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:44.767011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e55a-ec86-4def-9b56-c36389583246 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:44.767292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e55a-ec86-4def-9b56-c36389583246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:44.767599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08e55a-ec86-4def-9b56-c36389583246 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:44.768320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e55a-ec86-4def-9b56-c36389583246 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:44.768623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e55a-ec86-4def-9b56-c36389583246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:44.770155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08e55a-ec86-4def-9b56-c36389583246 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:44.777060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 588/1164] 10.222.0.60 () {56 vars in 1136 bytes} [Mon Feb 7 20:24:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:46.963209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bca51-5b47-4450-ba25-16bdc488a412 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:46.963843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bca51-5b47-4450-ba25-16bdc488a412 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:46.963843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bca51-5b47-4450-ba25-16bdc488a412 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:46.965583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 577/1165] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:46.970991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e2a90-787a-43f1-b954-a3f3ae329eb7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:46.971441 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e2a90-787a-43f1-b954-a3f3ae329eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:46.971598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e2a90-787a-43f1-b954-a3f3ae329eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:46.989435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-583e2a90-787a-43f1-b954-a3f3ae329eb7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:46.990616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-583e2a90-787a-43f1-b954-a3f3ae329eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:46.998829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 589/1166] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:47.021332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bca51-5b47-4450-ba25-16bdc488a412 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:47.148854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bca51-5b47-4450-ba25-16bdc488a412 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:47.153240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4e09f-45e9-4d6d-bbc4-18bd33426ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:47.153890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e09f-45e9-4d6d-bbc4-18bd33426ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:47.154167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e09f-45e9-4d6d-bbc4-18bd33426ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:47.154434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4e09f-45e9-4d6d-bbc4-18bd33426ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:47.155167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4e09f-45e9-4d6d-bbc4-18bd33426ff5 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:47.156439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-40c4e09f-45e9-4d6d-bbc4-18bd33426ff5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:24:47.156439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:24:47.156439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:24:47.157300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4e09f-45e9-4d6d-bbc4-18bd33426ff5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:47.171664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 578/1167] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Feb 7 20:24:47 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:49.384504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda628-735d-4335-ad07-4f102daa9d72 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:49.385057 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda628-735d-4335-ad07-4f102daa9d72 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:49.385435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda628-735d-4335-ad07-4f102daa9d72 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:49.387884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 590/1168] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:24:49.393655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7d55-5eea-426e-9930-9de818f7f499 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:49.394091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7d55-5eea-426e-9930-9de818f7f499 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:49.394189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7d55-5eea-426e-9930-9de818f7f499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:49.411783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-571a7d55-5eea-426e-9930-9de818f7f499 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:49.412949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-571a7d55-5eea-426e-9930-9de818f7f499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:49.466880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 579/1169] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:49.490116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda628-735d-4335-ad07-4f102daa9d72 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:49.502418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda628-735d-4335-ad07-4f102daa9d72 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:49.506755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc70a6-f1d5-48f7-80be-6e90da8b106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:49.508252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc70a6-f1d5-48f7-80be-6e90da8b106e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:49.508536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc70a6-f1d5-48f7-80be-6e90da8b106e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:49.508814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc70a6-f1d5-48f7-80be-6e90da8b106e admin admin] PATH_INFO: `/v3/domains/078fe2be09b148d8921c864945cc2acd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:49.519122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc70a6-f1d5-48f7-80be-6e90da8b106e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=078fe2be09b148d8921c864945cc2acd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:49.521123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc70a6-f1d5-48f7-80be-6e90da8b106e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:49.522724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 591/1170] 10.222.0.60 () {56 vars in 1204 bytes} [Mon Feb 7 20:24:49 2022] GET /identity/v3/domains/078fe2be09b148d8921c864945cc2acd => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:49.528390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7d55-5eea-426e-9930-9de818f7f499 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:49.537366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7d55-5eea-426e-9930-9de818f7f499 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:49.541837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0165e0-e010-4c1b-9b11-a34140762dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:49.542476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0165e0-e010-4c1b-9b11-a34140762dfe admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:49.542770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0165e0-e010-4c1b-9b11-a34140762dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:49.543045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0165e0-e010-4c1b-9b11-a34140762dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:49.543799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0165e0-e010-4c1b-9b11-a34140762dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:49.545682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0165e0-e010-4c1b-9b11-a34140762dfe admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:49.570440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 580/1171] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:24:49 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:24:51.777635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e3103-2a12-4a5e-8fde-4195070046c5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:51.778189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e3103-2a12-4a5e-8fde-4195070046c5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:51.778189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e3103-2a12-4a5e-8fde-4195070046c5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:51.779999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 592/1172] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:51.785499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352fa96-5cd7-472e-8871-cc50ca421ca7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:51.785907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352fa96-5cd7-472e-8871-cc50ca421ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:51.786055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352fa96-5cd7-472e-8871-cc50ca421ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:51.803813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c352fa96-5cd7-472e-8871-cc50ca421ca7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:51.804989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c352fa96-5cd7-472e-8871-cc50ca421ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:51.859993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 581/1173] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:51.884601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e3103-2a12-4a5e-8fde-4195070046c5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:51.896518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e3103-2a12-4a5e-8fde-4195070046c5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:51.901347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46365cd-b2f5-459e-8cdd-c2700c9d9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:51.902185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46365cd-b2f5-459e-8cdd-c2700c9d9eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:51.902470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46365cd-b2f5-459e-8cdd-c2700c9d9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:51.902752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46365cd-b2f5-459e-8cdd-c2700c9d9eb2 admin admin] PATH_INFO: `/v3/domains/078fe2be09b148d8921c864945cc2acd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:51.903975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46365cd-b2f5-459e-8cdd-c2700c9d9eb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=078fe2be09b148d8921c864945cc2acd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:51.906180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46365cd-b2f5-459e-8cdd-c2700c9d9eb2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:51.907769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 593/1174] 10.222.0.60 () {56 vars in 1204 bytes} [Mon Feb 7 20:24:51 2022] GET /identity/v3/domains/078fe2be09b148d8921c864945cc2acd => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:51.913039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352fa96-5cd7-472e-8871-cc50ca421ca7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:51.922182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352fa96-5cd7-472e-8871-cc50ca421ca7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:51.927242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c91751-c0a6-4b82-a325-5f9f1c2ea239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:51.927910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91751-c0a6-4b82-a325-5f9f1c2ea239 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:51.928188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91751-c0a6-4b82-a325-5f9f1c2ea239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:51.928462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91751-c0a6-4b82-a325-5f9f1c2ea239 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:51.929215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c91751-c0a6-4b82-a325-5f9f1c2ea239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:51.931097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c91751-c0a6-4b82-a325-5f9f1c2ea239 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:51.950759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 582/1175] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:24:51 2022] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:24:54.159736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b3d3-9bba-44cc-8494-b12561732612 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.160251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b3d3-9bba-44cc-8494-b12561732612 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.160341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b3d3-9bba-44cc-8494-b12561732612 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.162075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 594/1176] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:54.167343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce2ff4-43ac-43c2-bf7a-8501e9b794b6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.167793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce2ff4-43ac-43c2-bf7a-8501e9b794b6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.167926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce2ff4-43ac-43c2-bf7a-8501e9b794b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.185063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-fdce2ff4-43ac-43c2-bf7a-8501e9b794b6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:54.186236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fdce2ff4-43ac-43c2-bf7a-8501e9b794b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:54.193803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 583/1177] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:54.217805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6b3d3-9bba-44cc-8494-b12561732612 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:54.229540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6b3d3-9bba-44cc-8494-b12561732612 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:54.233777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:54.234527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.234807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.235111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.245943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:54.252789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:54.253904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 595/1178] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:54.259989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce2ff4-43ac-43c2-bf7a-8501e9b794b6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:54.268662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce2ff4-43ac-43c2-bf7a-8501e9b794b6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:54.273124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:54.273762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.274042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.274316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.275073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:54.275379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:54.276992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:54.285086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 584/1179] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:54.290200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:54.299337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becd37d-29c1-4db6-95ef-9de0ddc453bc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:54.304253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:54.305065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.305341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.305614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] PATH_INFO: `/v3/users/636f1a43026e4e81ae257bb5914ae374` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.318508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] RBAC: Authorizing `identity:get_user(user_id=636f1a43026e4e81ae257bb5914ae374)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:54.321294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:54.322855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 596/1180] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:54 2022] GET /identity/v3/users/636f1a43026e4e81ae257bb5914ae374 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:54.328053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:54.337271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707deca-8d45-4a0b-9676-eddd219f642d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:54.341721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:54.342337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.342621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.342902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.350421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:54.352181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:54.360817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 585/1181] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:54.365829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:54.375488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e1535-afa0-4890-80c3-b8f4043ccf2d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:54.379865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b773a3-fb37-4c38-8908-cb186f3a43b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:54.380673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b773a3-fb37-4c38-8908-cb186f3a43b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.380954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b773a3-fb37-4c38-8908-cb186f3a43b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.381231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b773a3-fb37-4c38-8908-cb186f3a43b2 admin admin] PATH_INFO: `/v3/projects/76c34ad6fb6c4789bfc115202a162e56` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.382995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b773a3-fb37-4c38-8908-cb186f3a43b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c34ad6fb6c4789bfc115202a162e56)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:54.385006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b773a3-fb37-4c38-8908-cb186f3a43b2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:54.386589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 597/1182] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:54 2022] GET /identity/v3/projects/76c34ad6fb6c4789bfc115202a162e56 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:54.391958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:54.400331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345d540-4d38-408f-8486-436f4e30f74d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:54.405271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b083198-bf39-4bc7-ba54-17d360e4d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:54.406149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083198-bf39-4bc7-ba54-17d360e4d651 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:54.406433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083198-bf39-4bc7-ba54-17d360e4d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:54.406710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083198-bf39-4bc7-ba54-17d360e4d651 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:54.407562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b083198-bf39-4bc7-ba54-17d360e4d651 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=76c34ad6fb6c4789bfc115202a162e56, user.id=636f1a43026e4e81ae257bb5914ae374) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:54.407874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b083198-bf39-4bc7-ba54-17d360e4d651 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:54.409659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b083198-bf39-4bc7-ba54-17d360e4d651 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:54.414926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 586/1183] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:54 2022] GET /identity/v3/role_assignments?user.id=636f1a43026e4e81ae257bb5914ae374&scope.project.id=76c34ad6fb6c4789bfc115202a162e56&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:56.567096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444382-14b2-4bb9-87c3-9003b7192812 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:56.567645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444382-14b2-4bb9-87c3-9003b7192812 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:56.567757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444382-14b2-4bb9-87c3-9003b7192812 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:56.569992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 598/1184] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:56.575186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a7132-df8f-4d1f-a1cd-c2ea4e460d82 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:56.575625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a7132-df8f-4d1f-a1cd-c2ea4e460d82 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:56.575781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a7132-df8f-4d1f-a1cd-c2ea4e460d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:56.592867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ad5a7132-df8f-4d1f-a1cd-c2ea4e460d82 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:56.594043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ad5a7132-df8f-4d1f-a1cd-c2ea4e460d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:56.601662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 587/1185] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:56.624590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31444382-14b2-4bb9-87c3-9003b7192812 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:56.637111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31444382-14b2-4bb9-87c3-9003b7192812 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:56.641361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:56.642118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:56.642396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:56.642669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:56.652490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:56.659500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:56.660621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 599/1186] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:56.666044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a7132-df8f-4d1f-a1cd-c2ea4e460d82 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:56.674764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a7132-df8f-4d1f-a1cd-c2ea4e460d82 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:56.679750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:56.680403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:56.680688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:56.680969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:56.681727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:56.682038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:56.683691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:56.691556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 588/1187] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:56.697430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:56.707121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddfbd9-0e29-4f04-b79d-600eeb74fec0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:56.711501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:56.712309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:56.712589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:56.712863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] PATH_INFO: `/v3/users/636f1a43026e4e81ae257bb5914ae374` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:56.714023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] RBAC: Authorizing `identity:get_user(user_id=636f1a43026e4e81ae257bb5914ae374)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:56.716154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:56.717813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 600/1188] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:56 2022] GET /identity/v3/users/636f1a43026e4e81ae257bb5914ae374 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:56.722541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:56.731568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb94a-eb78-43a6-9aa6-0f3613633b82 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:56.736020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c4bb-c4a3-4c1e-a7cf-bcdaeb232226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:56.736823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c4bb-c4a3-4c1e-a7cf-bcdaeb232226 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:56.737111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c4bb-c4a3-4c1e-a7cf-bcdaeb232226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:56.737393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c4bb-c4a3-4c1e-a7cf-bcdaeb232226 admin admin] PATH_INFO: `/v3/projects/76c34ad6fb6c4789bfc115202a162e56` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:56.738555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c4bb-c4a3-4c1e-a7cf-bcdaeb232226 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c34ad6fb6c4789bfc115202a162e56)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:56.740576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c4bb-c4a3-4c1e-a7cf-bcdaeb232226 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:56.742664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 589/1189] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:56 2022] GET /identity/v3/projects/76c34ad6fb6c4789bfc115202a162e56 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:56.747698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:56.757428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85d37-4b17-43ff-b6b5-8637e9becf82 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:56.761822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c913f7a-4cac-4d9f-99f1-decf10917557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:56.762638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c913f7a-4cac-4d9f-99f1-decf10917557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:56.762918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c913f7a-4cac-4d9f-99f1-decf10917557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:56.763190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c913f7a-4cac-4d9f-99f1-decf10917557 admin admin] PATH_INFO: `/v3/projects/76c34ad6fb6c4789bfc115202a162e56/users/636f1a43026e4e81ae257bb5914ae374/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:56.765143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c913f7a-4cac-4d9f-99f1-decf10917557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c34ad6fb6c4789bfc115202a162e56, user_id=636f1a43026e4e81ae257bb5914ae374, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:56.767725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c913f7a-4cac-4d9f-99f1-decf10917557 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:56.780167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 601/1190] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:24:56 2022] PUT /identity/v3/projects/76c34ad6fb6c4789bfc115202a162e56/users/636f1a43026e4e81ae257bb5914ae374/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:24:58.936324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710a39-75f2-432d-b98e-263f40fe0898 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:58.936797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710a39-75f2-432d-b98e-263f40fe0898 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:58.936896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710a39-75f2-432d-b98e-263f40fe0898 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:58.938686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 590/1191] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:24:58.944010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00fb0b-3038-4e35-8f86-020715879367 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:58.944442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00fb0b-3038-4e35-8f86-020715879367 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:58.944577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00fb0b-3038-4e35-8f86-020715879367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:58.963321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cb00fb0b-3038-4e35-8f86-020715879367 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:24:58.964533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cb00fb0b-3038-4e35-8f86-020715879367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:24:59.018595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 602/1192] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:24:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:24:59.043124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710a39-75f2-432d-b98e-263f40fe0898 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:59.055113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710a39-75f2-432d-b98e-263f40fe0898 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:59.059411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:59.060184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:59.060463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:59.060738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:59.070655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:24:59.077297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:24:59.078415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 591/1193] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:24:59.083904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00fb0b-3038-4e35-8f86-020715879367 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:59.093076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00fb0b-3038-4e35-8f86-020715879367 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:59.097540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:59.098186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:59.098469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:59.098781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:59.099602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:59.099912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:59.102133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:59.110326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 603/1194] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:59.116082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:59.126321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b51a2b-f501-436d-8d92-f026b629ea93 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:59.130682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:59.132058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:59.132336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:59.132607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] PATH_INFO: `/v3/users/636f1a43026e4e81ae257bb5914ae374` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:59.133786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=636f1a43026e4e81ae257bb5914ae374)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:59.135919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:59.137466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 592/1195] 10.222.0.60 () {56 vars in 1198 bytes} [Mon Feb 7 20:24:59 2022] GET /identity/v3/users/636f1a43026e4e81ae257bb5914ae374 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:24:59.142700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:59.152565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcb7bd-f3f4-4601-ab01-4a57527820f6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:59.157323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:59.157938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:59.158219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:59.158495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:59.165995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:59.167759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:59.176304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 604/1196] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:24:59 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:24:59.181515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:59.190602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647fdaf-e01f-4c46-a2e9-abfb8cd4edf3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:59.195513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39788173-d9e0-4865-8907-b4571b6b7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:59.196297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39788173-d9e0-4865-8907-b4571b6b7035 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:59.196575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39788173-d9e0-4865-8907-b4571b6b7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:59.196848 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39788173-d9e0-4865-8907-b4571b6b7035 admin admin] PATH_INFO: `/v3/projects/76c34ad6fb6c4789bfc115202a162e56` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:59.197983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39788173-d9e0-4865-8907-b4571b6b7035 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c34ad6fb6c4789bfc115202a162e56)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:59.199992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39788173-d9e0-4865-8907-b4571b6b7035 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:59.201547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 593/1197] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:24:59 2022] GET /identity/v3/projects/76c34ad6fb6c4789bfc115202a162e56 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:24:59.206751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:24:59.215737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b89296-2cd9-48af-bf7a-660b8b67c053 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:24:59.220193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c023fa-45cb-48be-b801-03be5de50025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:24:59.220791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c023fa-45cb-48be-b801-03be5de50025 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:24:59.221073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c023fa-45cb-48be-b801-03be5de50025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:24:59.221348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c023fa-45cb-48be-b801-03be5de50025 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:24:59.222171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c023fa-45cb-48be-b801-03be5de50025 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=76c34ad6fb6c4789bfc115202a162e56, user.id=636f1a43026e4e81ae257bb5914ae374) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:24:59.222480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c023fa-45cb-48be-b801-03be5de50025 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:24:59.224284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c023fa-45cb-48be-b801-03be5de50025 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:24:59.229824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 605/1198] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:24:59 2022] GET /identity/v3/role_assignments?user.id=636f1a43026e4e81ae257bb5914ae374&scope.project.id=76c34ad6fb6c4789bfc115202a162e56&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:25:59.081146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f324399-f307-4528-a812-b625c0c3d030 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:25:59.081809 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f324399-f307-4528-a812-b625c0c3d030 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:25:59.081809 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f324399-f307-4528-a812-b625c0c3d030 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:25:59.083752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 594/1199] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:25:59.091080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a795f8-cba1-44f7-b458-e10d0e6e7933 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:25:59.091080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a795f8-cba1-44f7-b458-e10d0e6e7933 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:25:59.091080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a795f8-cba1-44f7-b458-e10d0e6e7933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:25:59.109958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-55a795f8-cba1-44f7-b458-e10d0e6e7933 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:25:59.111240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-55a795f8-cba1-44f7-b458-e10d0e6e7933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:25:59.119850 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 606/1200] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:25:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:25:59.145982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f324399-f307-4528-a812-b625c0c3d030 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:25:59.159308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f324399-f307-4528-a812-b625c0c3d030 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:25:59.164035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:25:59.164818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:25:59.165100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:25:59.165393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:25:59.176819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:25:59.178638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:25:59.199028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:25:59.200656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 595/1201] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:25:59.206394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a795f8-cba1-44f7-b458-e10d0e6e7933 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:25:59.216786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a795f8-cba1-44f7-b458-e10d0e6e7933 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:25:59.222368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531749d-4a9e-4ce5-b958-5952acd29b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:25:59.222556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531749d-4a9e-4ce5-b958-5952acd29b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:25:59.222774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531749d-4a9e-4ce5-b958-5952acd29b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:25:59.223081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531749d-4a9e-4ce5-b958-5952acd29b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:25:59.223860 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531749d-4a9e-4ce5-b958-5952acd29b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:25:59.224169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531749d-4a9e-4ce5-b958-5952acd29b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:25:59.225773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531749d-4a9e-4ce5-b958-5952acd29b68 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:25:59.239839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 607/1202] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:25:59.247882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:25:59.258841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8f243-11ac-4fc9-9e99-887d92008745 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:25:59.267540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4370734-e34c-45fa-b0c2-43297cb32b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:25:59.268259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370734-e34c-45fa-b0c2-43297cb32b49 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:25:59.268552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370734-e34c-45fa-b0c2-43297cb32b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:25:59.268828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4370734-e34c-45fa-b0c2-43297cb32b49 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:25:59.270171 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370734-e34c-45fa-b0c2-43297cb32b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:25:59.272198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4370734-e34c-45fa-b0c2-43297cb32b49 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:25:59.307425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 596/1203] 10.222.0.60 () {60 vars in 1153 bytes} [Mon Feb 7 20:25:59 2022] POST /identity/v3/users => generated 251 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:26:01.732577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499a8e-e3c2-49ef-bd05-8f756bb14c1f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:01.733150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499a8e-e3c2-49ef-bd05-8f756bb14c1f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:01.733150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499a8e-e3c2-49ef-bd05-8f756bb14c1f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:01.735147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 608/1204] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:01.742318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345469-78f7-4b22-8d84-5e99bd1ebf31 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:01.742814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345469-78f7-4b22-8d84-5e99bd1ebf31 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:01.742922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345469-78f7-4b22-8d84-5e99bd1ebf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:01.764562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-50345469-78f7-4b22-8d84-5e99bd1ebf31 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:01.765897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-50345469-78f7-4b22-8d84-5e99bd1ebf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:01.775428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 597/1205] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:01.804004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7499a8e-e3c2-49ef-bd05-8f756bb14c1f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:01.817008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7499a8e-e3c2-49ef-bd05-8f756bb14c1f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:01.821739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:01.822644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:01.823032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:01.823436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:01.837486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:26:01.844544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:26:01.846024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 609/1206] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:01.853981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50345469-78f7-4b22-8d84-5e99bd1ebf31 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:01.863823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50345469-78f7-4b22-8d84-5e99bd1ebf31 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:01.871109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:01.872127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:01.872127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:01.872367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:01.873089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:01.873404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:01.875011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:01.883937 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 598/1207] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:01.890251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:01.900683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2ff2e-692b-4422-8b62-72cd2c1c3514 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:01.906201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:01.907055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:01.907262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:01.907760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:01.919989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:01.921827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:01.939722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:01.945542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 610/1208] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:01.946838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:01.957046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f12cc0-0788-4a75-a4a0-82d653d726b0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:01.961981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:01.962723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:01.963075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:01.963451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:01.964245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:01.964566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:01.966152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:01.978622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 599/1209] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:01.984246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:01.996592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e6c16-6c47-427d-bae0-0b30cd95f2b5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.001901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.002705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.003183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.003590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.011481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.013508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.029730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 20:26:02.031715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 611/1210] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:02.037774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:02.051259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278796c-c33d-434e-a505-2f044da2b484 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.056203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.056866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.057358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.057622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.058475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:02.058960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.060856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.079194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 600/1211] 10.222.0.60 () {56 vars in 1164 bytes} [Mon Feb 7 20:26:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:02.084980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:02.096657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5583-a342-44a4-9597-677373f27503 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.102988 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.103839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.104121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.104395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.112495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.115201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.131150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 612/1212] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:26:02 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:26:02.132406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:02.143057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93df9-6de5-46cf-a99f-70fd32d12568 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.149625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.150778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.151061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.151336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.165636 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.166693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.190229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:02.191774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 601/1213] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:02.198566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:02.210323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ea3f0-451d-46df-855d-f8172fc23e20 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.215333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.216349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.216658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.217002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.217891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:02.218213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.220289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.235549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 613/1214] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:02.243524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:02.255165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b8650-b0f6-4e4c-8821-5e2b4c4b3512 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.261369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.262329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.262609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.262888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.271734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.273732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.291005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:26:02.292415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 602/1215] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:02.299192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:02.311853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061c47e-cea1-44e1-b7fe-c23692d6ba52 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.317282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b3c61-ca60-41a5-9618-ddad61ca6d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.317934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3c61-ca60-41a5-9618-ddad61ca6d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.318214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3c61-ca60-41a5-9618-ddad61ca6d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.318490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3c61-ca60-41a5-9618-ddad61ca6d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.319291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b3c61-ca60-41a5-9618-ddad61ca6d16 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:02.319624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b3c61-ca60-41a5-9618-ddad61ca6d16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.321768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b3c61-ca60-41a5-9618-ddad61ca6d16 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.338226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 614/1216] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:02.345529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:02.360729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed90d-e1bd-424f-a6b1-3772d02b8fa3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:02.366508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be7897-4eaa-4198-927e-d343229a2d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:02.367294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be7897-4eaa-4198-927e-d343229a2d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:02.367674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be7897-4eaa-4198-927e-d343229a2d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:02.368022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be7897-4eaa-4198-927e-d343229a2d94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:02.369027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be7897-4eaa-4198-927e-d343229a2d94 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=28c7f1498d7e4ef79977166d285e5e43) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:02.369453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be7897-4eaa-4198-927e-d343229a2d94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:02.371446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be7897-4eaa-4198-927e-d343229a2d94 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:02.391717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 603/1217] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:26:02 2022] GET /identity/v3/role_assignments?user.id=28c7f1498d7e4ef79977166d285e5e43&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:04.747929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6d328-4cfe-4d3e-9338-06c97ad3837e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:04.748481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6d328-4cfe-4d3e-9338-06c97ad3837e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:04.748481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6d328-4cfe-4d3e-9338-06c97ad3837e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:04.750242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 615/1218] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:04.756822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ccf9-0075-4a51-b6f8-4ace918c2b57 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:04.757265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ccf9-0075-4a51-b6f8-4ace918c2b57 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:04.757473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ccf9-0075-4a51-b6f8-4ace918c2b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:04.777300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ba85ccf9-0075-4a51-b6f8-4ace918c2b57 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:04.778547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ba85ccf9-0075-4a51-b6f8-4ace918c2b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:04.788114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 604/1219] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:04.813614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6d328-4cfe-4d3e-9338-06c97ad3837e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:04.826805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6d328-4cfe-4d3e-9338-06c97ad3837e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:04.831781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:04.832572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:04.832856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:04.833133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:04.845513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:26:04.853703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:26:04.854947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 616/1220] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:26:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:04.861252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ccf9-0075-4a51-b6f8-4ace918c2b57 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:04.871816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ccf9-0075-4a51-b6f8-4ace918c2b57 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:04.876794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:04.877584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:04.877945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:04.878257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:04.879036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:04.879349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:04.880989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:04.890031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 605/1221] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:04.896809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:04.908532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32adea2-3d93-4514-b7a7-ea03bc4cacf0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:04.914076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:04.914941 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:04.915227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:04.915542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:04.927446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:04.929396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:04.947347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:04.948666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 617/1222] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:04.954527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:04.965104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fd748-3b00-4b87-9a5b-44886f669f53 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:04.970118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:04.970849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:04.971217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:04.971593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:04.972956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:04.973350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:04.975063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:04.988286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 606/1223] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:04.993692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:05.004697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0030-4404-446a-8bf5-546a71d81574 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:05.009862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:05.010848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:05.011145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:05.011520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:05.019176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:05.021305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:05.038131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 20:26:05.040085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 618/1224] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:05.045915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:05.058516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c148-88f7-4d4d-b4d3-58d1fafb0f1c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:05.064040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:05.064767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:05.065183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:05.065467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:05.066420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:05.066727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:05.068785 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:05.093044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 607/1225] 10.222.0.60 () {56 vars in 1164 bytes} [Mon Feb 7 20:26:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:05.094308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:05.106198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd92aad-e843-4903-bd6a-3811aeac4239 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:05.111284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:05.112132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:05.112446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:05.113285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:05.127994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:05.130185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:05.149105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:05.155247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 619/1226] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:05.156637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:05.167741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31591756-cd20-4879-9ba6-598f2e296b9e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:05.172597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:05.173447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:05.173734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:05.174009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:05.174740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:05.175079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:05.176735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:05.191469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 608/1227] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:05.196071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:05.209197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fdf91-a513-47d2-8b12-a1f65f9561ef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:05.213905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:05.214766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:05.215092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:05.215466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:05.223813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:05.225746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:05.238818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:26:05.240014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 620/1228] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:26:05.246278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:05.256859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dd0fd-e46c-4b19-bb59-fae5c389f5b5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:05.261417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e76f93-339b-4c96-87f7-8a24df5affdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:05.262159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76f93-339b-4c96-87f7-8a24df5affdc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:05.262537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76f93-339b-4c96-87f7-8a24df5affdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:05.262905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e76f93-339b-4c96-87f7-8a24df5affdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:05.263859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76f93-339b-4c96-87f7-8a24df5affdc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:05.264265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76f93-339b-4c96-87f7-8a24df5affdc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:05.266209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e76f93-339b-4c96-87f7-8a24df5affdc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:05.279710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 609/1229] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:05.287241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:05.298132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e82a1-9172-4511-bc2e-f9c1ec78e14e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:05.306335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7884-8bfc-4d1f-a9a3-beed8ca2cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:05.307220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7884-8bfc-4d1f-a9a3-beed8ca2cba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:05.307541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7884-8bfc-4d1f-a9a3-beed8ca2cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:05.307826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7884-8bfc-4d1f-a9a3-beed8ca2cba6 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/28c7f1498d7e4ef79977166d285e5e43/roles/3f92e68d5cb34c9d85db9e42baef4925` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:05.324665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7884-8bfc-4d1f-a9a3-beed8ca2cba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=28c7f1498d7e4ef79977166d285e5e43, role_id=3f92e68d5cb34c9d85db9e42baef4925)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:05.327360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7884-8bfc-4d1f-a9a3-beed8ca2cba6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:05.341426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 621/1230] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:26:05 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/28c7f1498d7e4ef79977166d285e5e43/roles/3f92e68d5cb34c9d85db9e42baef4925 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:26:07.762243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182b6f-d5b0-459f-9841-f6ab3e534860 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:07.762782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182b6f-d5b0-459f-9841-f6ab3e534860 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:07.762782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182b6f-d5b0-459f-9841-f6ab3e534860 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:07.764569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 610/1231] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:07.770559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317c2c-30ad-4025-b167-96b5bd0eaed7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:07.770997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317c2c-30ad-4025-b167-96b5bd0eaed7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:07.770997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317c2c-30ad-4025-b167-96b5bd0eaed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:07.789792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6d317c2c-30ad-4025-b167-96b5bd0eaed7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:07.790981 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6d317c2c-30ad-4025-b167-96b5bd0eaed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:07.850548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 622/1232] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:07.874605 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182b6f-d5b0-459f-9841-f6ab3e534860 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:07.887857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182b6f-d5b0-459f-9841-f6ab3e534860 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:07.892541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:07.893341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:07.894280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:07.894655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:07.905668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:26:07.912690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 20:26:07.913864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 611/1233] 10.222.0.60 () {56 vars in 1123 bytes} [Mon Feb 7 20:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:07.919887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d317c2c-30ad-4025-b167-96b5bd0eaed7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:07.933022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d317c2c-30ad-4025-b167-96b5bd0eaed7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:07.939366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:07.940171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:07.940359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:07.941157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:07.942498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:07.942808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:07.944488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:07.960196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 623/1234] 10.222.0.60 () {56 vars in 1124 bytes} [Mon Feb 7 20:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:07.961627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:07.972079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eaea8-eba6-4844-b312-691ad2aedcc5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:07.976793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:07.977559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:07.977840 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:07.978116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:07.989496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:07.991497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.010669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:08.012701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 612/1235] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:08.018598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.029397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89880708-4241-46f6-b98b-b971ca7a9721 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.034213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.034951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.035235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.035554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.036431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:08.036739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.038350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.050035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 624/1236] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:08.055734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.065320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43ecf9-2746-4a39-803a-5aaf4c24341b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.072927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.074104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.074600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.074884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.084125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.086247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.100862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 20:26:08.101991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 613/1237] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:08.107759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.117936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d45be-fad5-4475-afa7-214a33d4b627 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.122476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.123503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.123957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.124250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.125326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:08.125707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.127781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.148467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 625/1238] 10.222.0.60 () {56 vars in 1164 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:08.154181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.164582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3652a-38d2-47f4-8f8e-375ad441bb3b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.169093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.169703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.169982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.170252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.178550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.180321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.189032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 614/1239] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:26:08.195730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.205541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba78a-69db-412e-8bb2-3eca9e20edb4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.210334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.211115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.211419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.211707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.221934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.223843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.241737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:08.243041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 626/1240] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:08.249772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.259495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84cd2c-a6e4-4767-b343-082fe40b14e3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.264197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.264796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.265078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.265355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.266084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:08.266389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.268013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.280839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 615/1241] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:08.286564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.298629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22858-4a3a-42b7-baf5-c42e59fe545f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.305402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.306729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.307249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.307797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.317797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.319870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.334160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:26:08.335468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 627/1242] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:26:08.341449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.351692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210717-8f63-4c76-b9a9-ec89a1740b6f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.356701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83a527-b1ff-4e77-8f32-90e529c220b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.357428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83a527-b1ff-4e77-8f32-90e529c220b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.357729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83a527-b1ff-4e77-8f32-90e529c220b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.358006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83a527-b1ff-4e77-8f32-90e529c220b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.358836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83a527-b1ff-4e77-8f32-90e529c220b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:08.359190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83a527-b1ff-4e77-8f32-90e529c220b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.361306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83a527-b1ff-4e77-8f32-90e529c220b0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.374129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 616/1243] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:08.381477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:08.392967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa099c-f090-411d-96e3-40a643a560aa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:08.398025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b732-a355-4b96-bd94-13ee4c3d4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:08.398673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b732-a355-4b96-bd94-13ee4c3d4593 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:08.398985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b732-a355-4b96-bd94-13ee4c3d4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:08.399233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b732-a355-4b96-bd94-13ee4c3d4593 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:08.400145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17b732-a355-4b96-bd94-13ee4c3d4593 admin admin] RBAC: Adding query filter params (role.id=3f92e68d5cb34c9d85db9e42baef4925, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=28c7f1498d7e4ef79977166d285e5e43) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:08.400432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17b732-a355-4b96-bd94-13ee4c3d4593 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:08.402322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17b732-a355-4b96-bd94-13ee4c3d4593 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:08.408529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 628/1244] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:26:08 2022] GET /identity/v3/role_assignments?user.id=28c7f1498d7e4ef79977166d285e5e43&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=3f92e68d5cb34c9d85db9e42baef4925 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:10.882412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eaf92-b435-4a2f-8907-1518fa4fad27 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:10.882412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eaf92-b435-4a2f-8907-1518fa4fad27 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:10.882412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eaf92-b435-4a2f-8907-1518fa4fad27 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:10.882412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 617/1245] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:10.887936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b01bb-a9d9-46ba-b3a3-4fee654cce62 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:10.888350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b01bb-a9d9-46ba-b3a3-4fee654cce62 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:10.888489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b01bb-a9d9-46ba-b3a3-4fee654cce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:10.905992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9c0b01bb-a9d9-46ba-b3a3-4fee654cce62 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:10.907188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9c0b01bb-a9d9-46ba-b3a3-4fee654cce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:10.915677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 629/1246] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:10.941490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eaf92-b435-4a2f-8907-1518fa4fad27 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:10.954260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eaf92-b435-4a2f-8907-1518fa4fad27 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:10.958774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:10.959645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:10.959861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:10.960143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:10.973565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:26:10.981478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:26:10.982987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 618/1247] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:10.989836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b01bb-a9d9-46ba-b3a3-4fee654cce62 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.000521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b01bb-a9d9-46ba-b3a3-4fee654cce62 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.006104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.006846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.007128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.007597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.008563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:11.008957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.011018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.020585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 630/1248] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:11.026281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.037484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c71a4-5bf3-4dcb-854f-11b7300629c2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.042379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.043177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.043453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.043728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.054417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.056355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.073101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:11.074511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 619/1249] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:11.080417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.090265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab028eb-be8b-46c2-b5d3-3d0a3bf0ebc6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.096358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.097730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.098143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.098611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.099560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:11.099876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.101506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.114058 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 631/1250] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:11.119773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.130159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1f82a-23c5-4757-9cf3-842826c3ad3f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.134677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.135493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.135777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.136053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.145051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.147304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.164795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 20:26:11.167488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 620/1251] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:11.171745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.181616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75d34-f1e9-478c-b764-d67adc428341 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.186445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.187120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.187413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.187717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.188568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:11.188880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.190766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.210045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 632/1252] 10.222.0.60 () {56 vars in 1164 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:11.215951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.227519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08d1b3-8d69-46c7-bf6e-24838aec3552 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.232856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.233608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.233915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.234220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.242385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.244193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.254145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 621/1253] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:26:11.260124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.274538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64c595-1af4-4a8a-a74c-05639e4c5f2e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.279307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.280400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.280687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.280964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.292103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.293998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.312376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:11.313685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 633/1254] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:26:11.319801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.329990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ef4ae-5699-43a2-84a2-809c1cb7f2fb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.336363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.337177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.337496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.337860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.338772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:11.339226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.341336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.353981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 622/1255] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:11.360461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.370978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab64c6-52cc-45b6-8914-66b00d79862b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.375788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.376571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.376900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.377272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.385259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.387399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.402495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:26:11.404235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 634/1256] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:11.411380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.421460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f1bcd-a859-4d14-a00b-92070396b2ed admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.427001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa5d4f-18c6-4e14-b0a8-dca3f67363ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.427713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5d4f-18c6-4e14-b0a8-dca3f67363ad admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.428059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5d4f-18c6-4e14-b0a8-dca3f67363ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.428366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa5d4f-18c6-4e14-b0a8-dca3f67363ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.429231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5d4f-18c6-4e14-b0a8-dca3f67363ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:11.429548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5d4f-18c6-4e14-b0a8-dca3f67363ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.431424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa5d4f-18c6-4e14-b0a8-dca3f67363ad admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.444786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 623/1257] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:11.453353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:11.465376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b535-1a95-4dee-9200-ffe4a5c1afb9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:11.470442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284dd23-22fb-42ee-9bf5-e553bcb9e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:11.471145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284dd23-22fb-42ee-9bf5-e553bcb9e6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:11.472201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284dd23-22fb-42ee-9bf5-e553bcb9e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:11.472457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284dd23-22fb-42ee-9bf5-e553bcb9e6c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:11.473389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284dd23-22fb-42ee-9bf5-e553bcb9e6c2 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=28c7f1498d7e4ef79977166d285e5e43) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:11.474132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284dd23-22fb-42ee-9bf5-e553bcb9e6c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:11.476156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284dd23-22fb-42ee-9bf5-e553bcb9e6c2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:11.482150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 635/1258] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:26:11 2022] GET /identity/v3/role_assignments?user.id=28c7f1498d7e4ef79977166d285e5e43&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:13.969633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0ac1-d5ee-4357-bf5e-433e92ef22b9 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:13.970203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0ac1-d5ee-4357-bf5e-433e92ef22b9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:13.970203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0ac1-d5ee-4357-bf5e-433e92ef22b9 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:13.972038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 624/1259] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:13.979748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131de61-3bf5-4b68-a2ce-80ecd3654521 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:13.980203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131de61-3bf5-4b68-a2ce-80ecd3654521 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:13.980367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131de61-3bf5-4b68-a2ce-80ecd3654521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:13.997848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8131de61-3bf5-4b68-a2ce-80ecd3654521 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:13.999030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8131de61-3bf5-4b68-a2ce-80ecd3654521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:14.008182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 636/1260] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:14.034733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade0ac1-d5ee-4357-bf5e-433e92ef22b9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.048955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade0ac1-d5ee-4357-bf5e-433e92ef22b9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.054152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.055000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.055292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.055603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.067535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:26:14.076970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:26:14.078689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 625/1261] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:14.086166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131de61-3bf5-4b68-a2ce-80ecd3654521 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.095683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131de61-3bf5-4b68-a2ce-80ecd3654521 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.100418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.101153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.101439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.101722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.102512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:14.102822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.104512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.114038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 637/1262] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:14.120103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.130688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b7cb-8971-4c1c-b591-323b49d18f39 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.135539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.136349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.136635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.136915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.149332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.151195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.168469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:14.171570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 626/1263] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:26:14.176069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.186927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560d0e-6738-4338-a528-f7be1421de9b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.192745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.193564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.193915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.194272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.195181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:14.195568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.197178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.210277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 638/1264] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:14.216141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.226870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3588d-d7d4-4928-828a-8e0f7d01ffd6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.232121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.232996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.233295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.233653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.244300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.246330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.260864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 20:26:14.262034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 627/1265] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 20:26:14.268269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.278608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5be149-e263-41ae-be33-9969cb2d0215 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.283944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.284637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.284930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.285248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.286112 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:14.286464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.288632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.308328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 639/1266] 10.222.0.60 () {56 vars in 1164 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:14.314114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.326157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18616c1-a527-44d1-99dd-70fa37b1d414 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.330979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.331821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.332158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.332500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.344119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.346049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.363346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:14.364598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 628/1267] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:14.370740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.382324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cd9b5-e943-473f-a1ce-706beba29664 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.387173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.387844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.388127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.388416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.389210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:14.389549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.391300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.408653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 640/1268] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:14.409724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.419906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee4c43-cf64-4c40-a9f9-b5a40c7b939b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.425031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.425799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.426092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.426352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.433155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.435156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.449340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:26:14.450504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 629/1269] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:14.456297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.466712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a7946-74db-400a-8e8a-025ba8774f1f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.471553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d5b45-cb47-4c79-b8bd-15314bd367a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.472206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d5b45-cb47-4c79-b8bd-15314bd367a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.472490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d5b45-cb47-4c79-b8bd-15314bd367a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.472772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d5b45-cb47-4c79-b8bd-15314bd367a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.473572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d5b45-cb47-4c79-b8bd-15314bd367a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:14.473879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d5b45-cb47-4c79-b8bd-15314bd367a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.475799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d5b45-cb47-4c79-b8bd-15314bd367a9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.489026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 641/1270] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:14.495339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:14.508297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcbff7-2607-4024-9eef-d8a08efbe3ce admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:14.513611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37906bd8-0ac1-4de4-9ab9-785eb69933e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:14.514739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37906bd8-0ac1-4de4-9ab9-785eb69933e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:14.515116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37906bd8-0ac1-4de4-9ab9-785eb69933e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:14.515501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37906bd8-0ac1-4de4-9ab9-785eb69933e9 admin admin] PATH_INFO: `/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/28c7f1498d7e4ef79977166d285e5e43/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:14.518161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37906bd8-0ac1-4de4-9ab9-785eb69933e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c8ea7455b0419f8bd1f58d40a6580e, user_id=28c7f1498d7e4ef79977166d285e5e43, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:14.520886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37906bd8-0ac1-4de4-9ab9-785eb69933e9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:14.534950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 630/1271] 10.222.0.60 () {58 vars in 1460 bytes} [Mon Feb 7 20:26:14 2022] PUT /identity/v3/projects/13c8ea7455b0419f8bd1f58d40a6580e/users/28c7f1498d7e4ef79977166d285e5e43/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:26:16.842496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6742e4-68ca-4dd5-ac02-95bda63ceb72 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:16.843077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6742e4-68ca-4dd5-ac02-95bda63ceb72 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:16.843077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6742e4-68ca-4dd5-ac02-95bda63ceb72 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:16.845013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 642/1272] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:16.853285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027d95a-0283-46e0-89fb-31fdfab32a19 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:16.853815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027d95a-0283-46e0-89fb-31fdfab32a19 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:16.853927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027d95a-0283-46e0-89fb-31fdfab32a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:16.872988 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2027d95a-0283-46e0-89fb-31fdfab32a19 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:16.874145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2027d95a-0283-46e0-89fb-31fdfab32a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:16.936600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 631/1273] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:16.960366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6742e4-68ca-4dd5-ac02-95bda63ceb72 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:16.973748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6742e4-68ca-4dd5-ac02-95bda63ceb72 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:16.978315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:16.979124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:16.979442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:16.979729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:16.991526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 20:26:16.998313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 20:26:16.999558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 643/1274] 10.222.0.60 () {56 vars in 1117 bytes} [Mon Feb 7 20:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:17.005863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027d95a-0283-46e0-89fb-31fdfab32a19 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.015346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027d95a-0283-46e0-89fb-31fdfab32a19 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.020068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.020757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.021040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.021313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.022101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:17.022411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.024091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.034231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 632/1275] 10.222.0.60 () {56 vars in 1120 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:17.040302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.052094 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cae2ef-6710-4186-bbc6-087cafdb2bad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.056761 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.057565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.057848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.058126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.069426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.071297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.089027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:17.090474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 644/1276] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:17.096737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.107115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c61716-5c81-4307-bb07-a3ccbadf2cf9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.111955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.113126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.113407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.113684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.114440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:17.114750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.116430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.129155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 633/1277] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:17.134718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.145324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e439448-4dca-4e1e-a5f5-439f953b6f22 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.149932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.150748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.151033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.151311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.160228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.162267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.178171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 20:26:17.179443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 645/1278] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:17.185336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.195339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55be8-0572-43ab-9a34-04b097c1db5d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.200140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.200815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.201099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.201377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.202236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:17.202552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.204466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.224283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 634/1279] 10.222.0.60 () {56 vars in 1164 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:17.229821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.239639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7338-44f0-490f-9433-c85fd3a654b7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.244209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.244940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.245226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.245502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.253317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.255055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.263978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 646/1280] 10.222.0.60 () {58 vars in 1324 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:26:17.270299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.280382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6fe36-4bfc-4a50-87e9-fea26d399816 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.285384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.286155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.286432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.286705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.296729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.298559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.314971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 20:26:17.316191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 635/1281] 10.222.0.60 () {56 vars in 1129 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:17.321891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.331191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b7619-9b19-4c93-91fa-48f8fd07ecef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.335891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.336532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.336808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.337078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.337804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:17.338109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.339770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.351642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 647/1282] 10.222.0.60 () {56 vars in 1130 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:17.357443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.367347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e1e52-d12a-4588-a267-189a7a8094d1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.371891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.375063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.375063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.375063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.380011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.381952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.395220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING keystone.server.flask.application [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 20:26:17.396408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 636/1283] 10.222.0.60 () {56 vars in 1132 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:17.402273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.412980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e928a-c3d4-4860-a1a3-9d760bec6422 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.418577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec23cd-44ed-46d2-8115-bb01a133e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.419254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec23cd-44ed-46d2-8115-bb01a133e6ac admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.419571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec23cd-44ed-46d2-8115-bb01a133e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.419852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec23cd-44ed-46d2-8115-bb01a133e6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.420656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec23cd-44ed-46d2-8115-bb01a133e6ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:17.420967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec23cd-44ed-46d2-8115-bb01a133e6ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.422824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec23cd-44ed-46d2-8115-bb01a133e6ac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.435134 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 648/1284] 10.222.0.60 () {56 vars in 1169 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:26:17.441704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:17.452192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63a34a-1cc8-43e3-b3bd-e509c734bec0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:17.457689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94c617-f4aa-45c6-9cf8-9fa88118de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:17.458325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c617-f4aa-45c6-9cf8-9fa88118de07 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:17.458607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c617-f4aa-45c6-9cf8-9fa88118de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:17.458884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94c617-f4aa-45c6-9cf8-9fa88118de07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:17.459758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c617-f4aa-45c6-9cf8-9fa88118de07 admin admin] RBAC: Adding query filter params (role.id=e8e367d2563945e8b9f3144d0babc9f4, scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e, user.id=28c7f1498d7e4ef79977166d285e5e43) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:17.460074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c617-f4aa-45c6-9cf8-9fa88118de07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:17.461905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94c617-f4aa-45c6-9cf8-9fa88118de07 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:17.467916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 637/1285] 10.222.0.60 () {56 vars in 1395 bytes} [Mon Feb 7 20:26:17 2022] GET /identity/v3/role_assignments?user.id=28c7f1498d7e4ef79977166d285e5e43&scope.project.id=13c8ea7455b0419f8bd1f58d40a6580e&role.id=e8e367d2563945e8b9f3144d0babc9f4 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:19.665197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9707f7-d517-4932-96e0-91419e846344 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:19.665785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9707f7-d517-4932-96e0-91419e846344 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:19.665785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9707f7-d517-4932-96e0-91419e846344 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:19.668214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 649/1286] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:19.673983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba207d1-76fd-4cae-a657-ddc4adf3b898 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:19.674398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba207d1-76fd-4cae-a657-ddc4adf3b898 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:19.674627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba207d1-76fd-4cae-a657-ddc4adf3b898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:19.695228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1ba207d1-76fd-4cae-a657-ddc4adf3b898 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:19.696701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1ba207d1-76fd-4cae-a657-ddc4adf3b898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:19.706724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 638/1287] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:19.733045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9707f7-d517-4932-96e0-91419e846344 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:19.747436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9707f7-d517-4932-96e0-91419e846344 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:19.751843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:19.752615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:19.752900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:19.753179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:19.753848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:19.755468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:19.766114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 07 20:26:19.767227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 650/1288] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:26:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:19.773548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba207d1-76fd-4cae-a657-ddc4adf3b898 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:19.782599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba207d1-76fd-4cae-a657-ddc4adf3b898 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:19.787772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142318f-a6e7-40f8-8b90-ec7ff8b1f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:19.788526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142318f-a6e7-40f8-8b90-ec7ff8b1f932 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:19.788844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142318f-a6e7-40f8-8b90-ec7ff8b1f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:19.789155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142318f-a6e7-40f8-8b90-ec7ff8b1f932 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:19.789984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142318f-a6e7-40f8-8b90-ec7ff8b1f932 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:19.790341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142318f-a6e7-40f8-8b90-ec7ff8b1f932 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:19.792262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142318f-a6e7-40f8-8b90-ec7ff8b1f932 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:19.797494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 639/1289] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Feb 7 20:26:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:19.802506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:19.811634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d194-33eb-40d9-95b2-df3b9cc5e5b7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:19.816706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a13c-7255-48cb-b72b-ee963ddbe02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:19.817332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a13c-7255-48cb-b72b-ee963ddbe02e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:19.817614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a13c-7255-48cb-b72b-ee963ddbe02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:19.817893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a13c-7255-48cb-b72b-ee963ddbe02e admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:19.818597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a13c-7255-48cb-b72b-ee963ddbe02e admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:19.818900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a13c-7255-48cb-b72b-ee963ddbe02e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:19.820487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a13c-7255-48cb-b72b-ee963ddbe02e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:19.824755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 651/1290] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Feb 7 20:26:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:22.043366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d472b70-6159-437e-9523-c0d29bea8ba6 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:22.043993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d472b70-6159-437e-9523-c0d29bea8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:22.043993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d472b70-6159-437e-9523-c0d29bea8ba6 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:22.045698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 640/1291] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:22.050935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a3af-dba8-40cd-a8d7-853f385f25c5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:22.051319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a3af-dba8-40cd-a8d7-853f385f25c5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:22.051530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459a3af-dba8-40cd-a8d7-853f385f25c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:22.069129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1459a3af-dba8-40cd-a8d7-853f385f25c5 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:22.070286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1459a3af-dba8-40cd-a8d7-853f385f25c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:22.077789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 652/1292] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:22.100447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d472b70-6159-437e-9523-c0d29bea8ba6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:22.112745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d472b70-6159-437e-9523-c0d29bea8ba6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:22.117101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ec67b-a56a-47ca-8f8d-02a2e548a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:22.117734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec67b-a56a-47ca-8f8d-02a2e548a73b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:22.118017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec67b-a56a-47ca-8f8d-02a2e548a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:22.118295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ec67b-a56a-47ca-8f8d-02a2e548a73b admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:22.119029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec67b-a56a-47ca-8f8d-02a2e548a73b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:22.120657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ec67b-a56a-47ca-8f8d-02a2e548a73b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:22.133380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 641/1293] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Feb 7 20:26:22 2022] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:26:24.329914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194b53-2831-46de-b878-e3fe633ab920 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:24.330989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194b53-2831-46de-b878-e3fe633ab920 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:24.331101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194b53-2831-46de-b878-e3fe633ab920 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:24.332804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 653/1294] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:24.338040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbfe8-5dd2-4b08-9984-f987df2117e9 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:24.338442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbfe8-5dd2-4b08-9984-f987df2117e9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:24.338630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dbfe8-5dd2-4b08-9984-f987df2117e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:24.356257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ce9dbfe8-5dd2-4b08-9984-f987df2117e9 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:24.357446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ce9dbfe8-5dd2-4b08-9984-f987df2117e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:24.373496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 642/1295] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:24 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:24.398834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a194b53-2831-46de-b878-e3fe633ab920 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:24.411244 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a194b53-2831-46de-b878-e3fe633ab920 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:24.415561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:24.416317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:24.416596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:24.416868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:24.417525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:24.419094 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:24.429674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 07 20:26:24.430803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 654/1296] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:26:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:24.436778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbfe8-5dd2-4b08-9984-f987df2117e9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:24.446050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dbfe8-5dd2-4b08-9984-f987df2117e9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:24.450625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:24.451263 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:24.451581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:24.451863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:24.452583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:24.452892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:24.454529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:24.460217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 643/1297] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Feb 7 20:26:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:24.465603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:24.474869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f6cd-74da-4e5a-b057-9cbccb032750 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:24.479249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9738f5-d14a-4d61-af0a-80715843ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:24.479903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9738f5-d14a-4d61-af0a-80715843ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:24.480184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9738f5-d14a-4d61-af0a-80715843ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:24.480457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9738f5-d14a-4d61-af0a-80715843ed52 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:24.481238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9738f5-d14a-4d61-af0a-80715843ed52 admin admin] RBAC: Adding query filter params (interface=public, service_id=f9b9a1549696429696f1ac2cbbad992d, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:24.481549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9738f5-d14a-4d61-af0a-80715843ed52 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:24.483092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9738f5-d14a-4d61-af0a-80715843ed52 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:24.487860 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 655/1298] 10.222.0.60 () {56 vars in 1272 bytes} [Mon Feb 7 20:26:24 2022] GET /identity/v3/endpoints?service_id=f9b9a1549696429696f1ac2cbbad992d&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:24.492856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:24.501895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0e966-b317-4d09-8e57-9ebba81e5c4d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:24.506815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5be145-9846-4bf2-ba47-ab2058a23786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:24.507455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be145-9846-4bf2-ba47-ab2058a23786 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:24.507745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be145-9846-4bf2-ba47-ab2058a23786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:24.508020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be145-9846-4bf2-ba47-ab2058a23786 admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:24.508689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be145-9846-4bf2-ba47-ab2058a23786 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:24.510233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be145-9846-4bf2-ba47-ab2058a23786 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:24.516713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 644/1299] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:26:24 2022] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:26:26.681081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c17d67-86e9-4372-82cf-e6b64409e5c6 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:26.681745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c17d67-86e9-4372-82cf-e6b64409e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:26.681745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c17d67-86e9-4372-82cf-e6b64409e5c6 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:26.687456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 656/1300] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:26:26.690092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83ce1-6e08-44df-aedf-14a1c368448c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:26.690603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83ce1-6e08-44df-aedf-14a1c368448c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:26.690736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83ce1-6e08-44df-aedf-14a1c368448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:26.708606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-07e83ce1-6e08-44df-aedf-14a1c368448c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:26:26.709777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-07e83ce1-6e08-44df-aedf-14a1c368448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:26:26.717237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 645/1301] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:26:26 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:26:26.739465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c17d67-86e9-4372-82cf-e6b64409e5c6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:26.751116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c17d67-86e9-4372-82cf-e6b64409e5c6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:26.755887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:26.756646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:26.756922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:26.757194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:26.757849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:26.759447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:26.770545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 07 20:26:26.771672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 657/1302] 10.222.0.60 () {56 vars in 1138 bytes} [Mon Feb 7 20:26:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 20:26:26.777214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e83ce1-6e08-44df-aedf-14a1c368448c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:26.786116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e83ce1-6e08-44df-aedf-14a1c368448c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:26.790552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12713-1a11-4f7a-b0c9-8c6605e80bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:26.791183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12713-1a11-4f7a-b0c9-8c6605e80bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:26.791503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12713-1a11-4f7a-b0c9-8c6605e80bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:26.791782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12713-1a11-4f7a-b0c9-8c6605e80bbd admin admin] PATH_INFO: `/v3/services` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:26.792491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12713-1a11-4f7a-b0c9-8c6605e80bbd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:26:26.792796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12713-1a11-4f7a-b0c9-8c6605e80bbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:26.794367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12713-1a11-4f7a-b0c9-8c6605e80bbd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:26.799261 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 646/1303] 10.222.0.60 () {56 vars in 1137 bytes} [Mon Feb 7 20:26:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:26:26.804318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:26:26.813819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d9fc-1f12-4299-8d63-c8db6e83792a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:26:26.818718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d2fb-f324-4859-8581-4fc652e72d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:26:26.819323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d2fb-f324-4859-8581-4fc652e72d1e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:26:26.819637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d2fb-f324-4859-8581-4fc652e72d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:26:26.819915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d2fb-f324-4859-8581-4fc652e72d1e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:26:26.820651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d2fb-f324-4859-8581-4fc652e72d1e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:26:26.822180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d2fb-f324-4859-8581-4fc652e72d1e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:26:26.839876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 658/1304] 10.222.0.60 () {60 vars in 1165 bytes} [Mon Feb 7 20:26:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:27:29.580321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd626-65fd-4f29-9389-022c00fd0b5f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:29.581345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd626-65fd-4f29-9389-022c00fd0b5f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:29.581838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd626-65fd-4f29-9389-022c00fd0b5f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:29.587854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 647/1305] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:29.589250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e95e-1847-43c2-9d8a-c67c9f1d853c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:29.590271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e95e-1847-43c2-9d8a-c67c9f1d853c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:29.590772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e95e-1847-43c2-9d8a-c67c9f1d853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:29.728011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f892e95e-1847-43c2-9d8a-c67c9f1d853c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:29.732972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f892e95e-1847-43c2-9d8a-c67c9f1d853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:29.922300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 659/1306] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:27:29.946105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd626-65fd-4f29-9389-022c00fd0b5f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:29.947833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-dd2cd626-65fd-4f29-9389-022c00fd0b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:30.083492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd626-65fd-4f29-9389-022c00fd0b5f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:30.176016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abdc6d-91a6-41fd-bf47-14dbc5cbb942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:30.176697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdc6d-91a6-41fd-bf47-14dbc5cbb942 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:30.176973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdc6d-91a6-41fd-bf47-14dbc5cbb942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:30.177244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abdc6d-91a6-41fd-bf47-14dbc5cbb942 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:30.177990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abdc6d-91a6-41fd-bf47-14dbc5cbb942 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:30.179887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abdc6d-91a6-41fd-bf47-14dbc5cbb942 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:30.199661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 648/1307] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:27:29 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:27:32.448262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976e2e-17ba-4b2d-a352-e67b3b44eda4 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:32.448809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976e2e-17ba-4b2d-a352-e67b3b44eda4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:32.448809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976e2e-17ba-4b2d-a352-e67b3b44eda4 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:32.450618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 660/1308] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:32.456525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52f609-1cb3-4c0e-bcec-2529114866a7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:32.456914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52f609-1cb3-4c0e-bcec-2529114866a7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:32.457085 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52f609-1cb3-4c0e-bcec-2529114866a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:32.524200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5f52f609-1cb3-4c0e-bcec-2529114866a7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:32.525303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5f52f609-1cb3-4c0e-bcec-2529114866a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:32.621941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 649/1309] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:32.645973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92976e2e-17ba-4b2d-a352-e67b3b44eda4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:32.647529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-92976e2e-17ba-4b2d-a352-e67b3b44eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:32.796682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92976e2e-17ba-4b2d-a352-e67b3b44eda4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:32.894592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e1e6e-e923-4a03-83e3-c522aaae72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:32.895424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e1e6e-e923-4a03-83e3-c522aaae72fb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:32.895817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e1e6e-e923-4a03-83e3-c522aaae72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:32.896221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e1e6e-e923-4a03-83e3-c522aaae72fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:32.897078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e1e6e-e923-4a03-83e3-c522aaae72fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:32.899053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e1e6e-e923-4a03-83e3-c522aaae72fb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:32.918124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 661/1310] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:27:32 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:27:35.184305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc5dd-57be-4851-88c8-ad65fe3c224b None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:35.184799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc5dd-57be-4851-88c8-ad65fe3c224b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:35.184799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bc5dd-57be-4851-88c8-ad65fe3c224b None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:35.187135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 650/1311] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:35.192461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996118-78c3-43a1-a3a7-56a015bfe340 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:35.192852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996118-78c3-43a1-a3a7-56a015bfe340 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:35.193029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996118-78c3-43a1-a3a7-56a015bfe340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:35.259420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-61996118-78c3-43a1-a3a7-56a015bfe340 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:35.260656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-61996118-78c3-43a1-a3a7-56a015bfe340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:35.354214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 662/1312] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:35.403954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2322-e8f8-42fb-9afc-e4d3612c5bae None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:35.404280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2322-e8f8-42fb-9afc-e4d3612c5bae None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:35.404562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2322-e8f8-42fb-9afc-e4d3612c5bae None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:35.406322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 651/1313] 10.222.0.60 () {54 vars in 964 bytes} [Mon Feb 7 20:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:35.412323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa061-1d7c-4299-8e18-b100e36e4bd3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:35.412614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa061-1d7c-4299-8e18-b100e36e4bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:35.412890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa061-1d7c-4299-8e18-b100e36e4bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:35.486767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b73fa061-1d7c-4299-8e18-b100e36e4bd3 None None] MFA Rules not processed for user `7b86cad4ee844bdeae28d8a07d8a49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:35.487942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b73fa061-1d7c-4299-8e18-b100e36e4bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:35.566851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 663/1314] 10.222.0.60 () {58 vars in 1061 bytes} [Mon Feb 7 20:27:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:35.575900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2322-e8f8-42fb-9afc-e4d3612c5bae None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:35.577422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c27e2322-e8f8-42fb-9afc-e4d3612c5bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:35.676108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2322-e8f8-42fb-9afc-e4d3612c5bae None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:35.745186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7259a4-ba84-4121-a6e9-883bafec114c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:35.745746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7259a4-ba84-4121-a6e9-883bafec114c service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:35.746026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7259a4-ba84-4121-a6e9-883bafec114c service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:35.746299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7259a4-ba84-4121-a6e9-883bafec114c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:35.747936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ac7259a4-ba84-4121-a6e9-883bafec114c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:35.850417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7259a4-ba84-4121-a6e9-883bafec114c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:35.851895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7259a4-ba84-4121-a6e9-883bafec114c service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:35.870828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 652/1315] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:27:38.318704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb769f8-311e-4637-9beb-f32f0c0280f3 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:38.319241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb769f8-311e-4637-9beb-f32f0c0280f3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:38.319241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb769f8-311e-4637-9beb-f32f0c0280f3 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:38.321080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 664/1316] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:38.326172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:38.327112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:38.327305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:38.388713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:38.390443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:38.481568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 653/1317] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:38.514775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb769f8-311e-4637-9beb-f32f0c0280f3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:38.516336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8bb769f8-311e-4637-9beb-f32f0c0280f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:38.636626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb769f8-311e-4637-9beb-f32f0c0280f3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:38.723477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab291b90-3a6c-4511-8e68-351f8ff681e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:38.724324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab291b90-3a6c-4511-8e68-351f8ff681e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:38.724606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab291b90-3a6c-4511-8e68-351f8ff681e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:38.724881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab291b90-3a6c-4511-8e68-351f8ff681e2 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:38.725790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab291b90-3a6c-4511-8e68-351f8ff681e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:38.727602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab291b90-3a6c-4511-8e68-351f8ff681e2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:38.729282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 665/1318] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:27:38 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:27:38.740890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:38.742077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:38.829274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eb2cb-dd5f-469d-9d1c-5f3881fa8f28 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:38.899762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcba63-c0ad-49f2-a712-044182859185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:38.900344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcba63-c0ad-49f2-a712-044182859185 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:38.900633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcba63-c0ad-49f2-a712-044182859185 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:38.900908 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcba63-c0ad-49f2-a712-044182859185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:38.902536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c2dcba63-c0ad-49f2-a712-044182859185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:39.005932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcba63-c0ad-49f2-a712-044182859185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:39.007359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcba63-c0ad-49f2-a712-044182859185 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:39.024911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 654/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:27:41.513245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6e1b-169f-4bae-9158-0536b7b58974 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:41.513751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6e1b-169f-4bae-9158-0536b7b58974 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:41.513751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6e1b-169f-4bae-9158-0536b7b58974 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:41.515543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 666/1320] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:27:41.520666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:41.521094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:41.521219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:41.583208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:41.584419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:41.676087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 655/1321] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:27:41.711995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6e1b-169f-4bae-9158-0536b7b58974 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:41.713506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7e1b6e1b-169f-4bae-9158-0536b7b58974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:41.831620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6e1b-169f-4bae-9158-0536b7b58974 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:41.919682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c726a3-d2a0-45c1-aaef-3d6931c526e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:41.920575 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c726a3-d2a0-45c1-aaef-3d6931c526e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:41.920851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c726a3-d2a0-45c1-aaef-3d6931c526e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:41.921124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c726a3-d2a0-45c1-aaef-3d6931c526e1 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:41.930410 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c726a3-d2a0-45c1-aaef-3d6931c526e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:41.932475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c726a3-d2a0-45c1-aaef-3d6931c526e1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:41.934138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 667/1322] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:27:41 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:27:41.946115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:41.947306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:42.033866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f240-e33f-4f1d-98a4-2e952586b1ed None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:42.102780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cf509-78df-47e7-ba9a-af71fc442a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:42.103344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cf509-78df-47e7-ba9a-af71fc442a3b service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:42.103655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cf509-78df-47e7-ba9a-af71fc442a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:42.103929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cf509-78df-47e7-ba9a-af71fc442a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:42.105527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cc8cf509-78df-47e7-ba9a-af71fc442a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:42.208833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cf509-78df-47e7-ba9a-af71fc442a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:42.210256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cf509-78df-47e7-ba9a-af71fc442a3b service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:42.227751 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 656/1323] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:27:44.924954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44dd3b-96ce-4728-8f5b-15e36ad0212e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:44.925450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44dd3b-96ce-4728-8f5b-15e36ad0212e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:44.925562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44dd3b-96ce-4728-8f5b-15e36ad0212e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:44.927261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 668/1324] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:44.932355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33adbde-6295-4c65-8487-75f71131110b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:44.932736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33adbde-6295-4c65-8487-75f71131110b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:44.932906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33adbde-6295-4c65-8487-75f71131110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:44.995041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d33adbde-6295-4c65-8487-75f71131110b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:44.996290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d33adbde-6295-4c65-8487-75f71131110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:45.090524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 657/1325] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:45.125741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44dd3b-96ce-4728-8f5b-15e36ad0212e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:45.127186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5c44dd3b-96ce-4728-8f5b-15e36ad0212e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:45.247696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44dd3b-96ce-4728-8f5b-15e36ad0212e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:45.343414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45c399-c68c-42d1-8629-021778779f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:45.344264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c399-c68c-42d1-8629-021778779f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:45.344548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c399-c68c-42d1-8629-021778779f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:45.344821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c399-c68c-42d1-8629-021778779f81 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:45.354285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45c399-c68c-42d1-8629-021778779f81 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:45.356360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45c399-c68c-42d1-8629-021778779f81 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:45.358594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 669/1326] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:27:45 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:27:45.386126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd191b-4813-4458-914a-1212d0aabfa8 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:45.386414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd191b-4813-4458-914a-1212d0aabfa8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:45.386690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd191b-4813-4458-914a-1212d0aabfa8 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:45.388488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 658/1327] 10.222.0.60 () {54 vars in 964 bytes} [Mon Feb 7 20:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:45.394459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aeff7-68ee-4441-9911-b95996458ea1 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:45.394749 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aeff7-68ee-4441-9911-b95996458ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:45.395028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aeff7-68ee-4441-9911-b95996458ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:45.465897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e56aeff7-68ee-4441-9911-b95996458ea1 None None] MFA Rules not processed for user `7b86cad4ee844bdeae28d8a07d8a49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:45.467608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e56aeff7-68ee-4441-9911-b95996458ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:45.538883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 670/1328] 10.222.0.60 () {58 vars in 1061 bytes} [Mon Feb 7 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:45.548301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd191b-4813-4458-914a-1212d0aabfa8 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:45.549790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7fdd191b-4813-4458-914a-1212d0aabfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:45.647850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd191b-4813-4458-914a-1212d0aabfa8 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:45.721776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6bb8a-86f3-46cb-8334-a581efc0cfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:45.722417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6bb8a-86f3-46cb-8334-a581efc0cfdd service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:45.722700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6bb8a-86f3-46cb-8334-a581efc0cfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:45.722996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6bb8a-86f3-46cb-8334-a581efc0cfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:45.724643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-43a6bb8a-86f3-46cb-8334-a581efc0cfdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:45.827544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6bb8a-86f3-46cb-8334-a581efc0cfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:45.828962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6bb8a-86f3-46cb-8334-a581efc0cfdd service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:45.845958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 659/1329] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:27:49.138446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7df3e-caef-47ee-856f-2b350489a12b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:49.138981 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7df3e-caef-47ee-856f-2b350489a12b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:49.138981 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7df3e-caef-47ee-856f-2b350489a12b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:49.140800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 671/1330] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:49.145974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c4c50-a4a4-41ac-abd3-9acb48b0ace2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:49.146388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c4c50-a4a4-41ac-abd3-9acb48b0ace2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:49.146616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c4c50-a4a4-41ac-abd3-9acb48b0ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:49.209357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-051c4c50-a4a4-41ac-abd3-9acb48b0ace2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:49.210557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-051c4c50-a4a4-41ac-abd3-9acb48b0ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:49.310316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 660/1331] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:49.346300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7df3e-caef-47ee-856f-2b350489a12b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:49.348068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-42c7df3e-caef-47ee-856f-2b350489a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:49.458557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7df3e-caef-47ee-856f-2b350489a12b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:49.529678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7260ee-a3b5-449f-868e-eb5471956892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:49.530336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7260ee-a3b5-449f-868e-eb5471956892 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:49.530624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7260ee-a3b5-449f-868e-eb5471956892 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:49.530905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7260ee-a3b5-449f-868e-eb5471956892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:49.532604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fb7260ee-a3b5-449f-868e-eb5471956892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:49.637760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7260ee-a3b5-449f-868e-eb5471956892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:49.639769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7260ee-a3b5-449f-868e-eb5471956892 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:49.657942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 672/1332] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:27:51.982021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f325529-1600-41f0-8842-714d685f7a00 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:51.982615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f325529-1600-41f0-8842-714d685f7a00 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:51.982615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f325529-1600-41f0-8842-714d685f7a00 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:51.984428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 661/1333] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:51.989723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be702-fbec-4387-bfcc-69e51ad5fad8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:51.990168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be702-fbec-4387-bfcc-69e51ad5fad8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:51.990285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234be702-fbec-4387-bfcc-69e51ad5fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:52.055792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-234be702-fbec-4387-bfcc-69e51ad5fad8 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:52.057002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-234be702-fbec-4387-bfcc-69e51ad5fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:52.149709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 673/1334] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:52.184482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f325529-1600-41f0-8842-714d685f7a00 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:52.186611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1f325529-1600-41f0-8842-714d685f7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:52.285336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f325529-1600-41f0-8842-714d685f7a00 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:52.355941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bf6a8-f868-4fcb-b60c-31d929b6aa4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:52.356588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bf6a8-f868-4fcb-b60c-31d929b6aa4b service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:52.356867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bf6a8-f868-4fcb-b60c-31d929b6aa4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:52.357140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bf6a8-f868-4fcb-b60c-31d929b6aa4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:52.358749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-322bf6a8-f868-4fcb-b60c-31d929b6aa4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:52.462506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bf6a8-f868-4fcb-b60c-31d929b6aa4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:52.463900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bf6a8-f868-4fcb-b60c-31d929b6aa4b service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:52.480919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 662/1335] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:27:54.741297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11aa08-45d8-4784-953e-02e2a5d58208 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:54.741819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11aa08-45d8-4784-953e-02e2a5d58208 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:54.741925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11aa08-45d8-4784-953e-02e2a5d58208 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:54.743695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 674/1336] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:54.749071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:54.749478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:54.749639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:54.812932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:54.814116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:54.911701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 663/1337] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:54.942716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11aa08-45d8-4784-953e-02e2a5d58208 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:54.944346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ab11aa08-45d8-4784-953e-02e2a5d58208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:55.064331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11aa08-45d8-4784-953e-02e2a5d58208 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:55.151573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31988f5-42e4-42f9-bbdb-c27507ff3795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:55.152416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31988f5-42e4-42f9-bbdb-c27507ff3795 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:55.152696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31988f5-42e4-42f9-bbdb-c27507ff3795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:55.152971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31988f5-42e4-42f9-bbdb-c27507ff3795 admin admin] PATH_INFO: `/v3/projects/630217dacb45427f8c81275638cd7197` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:55.163367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31988f5-42e4-42f9-bbdb-c27507ff3795 admin admin] RBAC: Authorizing `identity:get_project(project_id=630217dacb45427f8c81275638cd7197)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:55.165488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31988f5-42e4-42f9-bbdb-c27507ff3795 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:55.172273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 675/1338] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:27:54 2022] GET /identity/v3/projects/630217dacb45427f8c81275638cd7197 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:27:55.178635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:55.180104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:55.268404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d513e-34c9-47a9-b9ae-759cee7dc161 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:55.337712 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3e79-7f0c-4485-9c2e-8aa58850d588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:55.338276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3e79-7f0c-4485-9c2e-8aa58850d588 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:55.338553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3e79-7f0c-4485-9c2e-8aa58850d588 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:55.338823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3e79-7f0c-4485-9c2e-8aa58850d588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:55.340479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f22f3e79-7f0c-4485-9c2e-8aa58850d588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:55.445877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3e79-7f0c-4485-9c2e-8aa58850d588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:55.447323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3e79-7f0c-4485-9c2e-8aa58850d588 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:55.465183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 664/1339] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:27:57.908563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666832a1-8f17-46ee-96f9-719f7138d539 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:57.909383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666832a1-8f17-46ee-96f9-719f7138d539 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:57.909677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666832a1-8f17-46ee-96f9-719f7138d539 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:57.911555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 676/1340] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:27:57.917334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3382d58-5665-4c9a-802e-3600cad76a4e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:57.917835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3382d58-5665-4c9a-802e-3600cad76a4e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:57.917928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3382d58-5665-4c9a-802e-3600cad76a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:57.985044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e3382d58-5665-4c9a-802e-3600cad76a4e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:27:57.986248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e3382d58-5665-4c9a-802e-3600cad76a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:58.084438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 665/1341] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:27:58.120816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666832a1-8f17-46ee-96f9-719f7138d539 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:27:58.122423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-666832a1-8f17-46ee-96f9-719f7138d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:58.223445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666832a1-8f17-46ee-96f9-719f7138d539 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:27:58.294175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1a5bd-ffb6-4ba3-9084-18859946691e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:27:58.295345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1a5bd-ffb6-4ba3-9084-18859946691e service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:27:58.295655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1a5bd-ffb6-4ba3-9084-18859946691e service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:27:58.295931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1a5bd-ffb6-4ba3-9084-18859946691e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:27:58.297550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-32f1a5bd-ffb6-4ba3-9084-18859946691e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:27:58.401985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1a5bd-ffb6-4ba3-9084-18859946691e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:27:58.404327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1a5bd-ffb6-4ba3-9084-18859946691e service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:27:58.422045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 677/1342] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:00.684772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6369-c1b7-4a02-8fe2-05d6e8a89799 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:00.685329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6369-c1b7-4a02-8fe2-05d6e8a89799 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:00.685329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6369-c1b7-4a02-8fe2-05d6e8a89799 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:00.687089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 666/1343] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:00.692316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:00.692730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:00.692908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:00.759952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:00.761144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:00.861147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 678/1344] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:00.897027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6369-c1b7-4a02-8fe2-05d6e8a89799 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:00.910977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6369-c1b7-4a02-8fe2-05d6e8a89799 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:00.915361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ec966-f305-4cfc-95ab-9f0382e19092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:00.916219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec966-f305-4cfc-95ab-9f0382e19092 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:00.916521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec966-f305-4cfc-95ab-9f0382e19092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:00.916798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ec966-f305-4cfc-95ab-9f0382e19092 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:00.917995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec966-f305-4cfc-95ab-9f0382e19092 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:00.919831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ec966-f305-4cfc-95ab-9f0382e19092 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:00.921456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 667/1345] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:28:00 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:28:00.932700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:00.934074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:01.021542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9734c5-de5f-483a-ba6f-2244abf9d6ad None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:01.025077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b6edf-899d-4194-86ae-2154a3fb951e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:01.025708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6edf-899d-4194-86ae-2154a3fb951e service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:01.025990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6edf-899d-4194-86ae-2154a3fb951e service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:01.026267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b6edf-899d-4194-86ae-2154a3fb951e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:01.035912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b6edf-899d-4194-86ae-2154a3fb951e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:01.037337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b6edf-899d-4194-86ae-2154a3fb951e service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:01.046262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 679/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:03.648740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06567f2-5842-43f7-b69d-e4246e008772 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:03.649287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06567f2-5842-43f7-b69d-e4246e008772 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:03.649287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06567f2-5842-43f7-b69d-e4246e008772 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:03.651047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 668/1347] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:03.656969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fad7f-4c77-47b6-b236-de18ec8a4d12 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:03.657392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fad7f-4c77-47b6-b236-de18ec8a4d12 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:03.657523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fad7f-4c77-47b6-b236-de18ec8a4d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:03.674605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c62fad7f-4c77-47b6-b236-de18ec8a4d12 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:03.676019 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c62fad7f-4c77-47b6-b236-de18ec8a4d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:03.686024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 680/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:03.725315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06567f2-5842-43f7-b69d-e4246e008772 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:03.726963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b06567f2-5842-43f7-b69d-e4246e008772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:03.739689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06567f2-5842-43f7-b69d-e4246e008772 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:03.743167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d3367-ce0f-46fb-84c6-d29d315c0fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:03.743815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d3367-ce0f-46fb-84c6-d29d315c0fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:03.744101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d3367-ce0f-46fb-84c6-d29d315c0fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:03.744377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d3367-ce0f-46fb-84c6-d29d315c0fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:03.753179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d3367-ce0f-46fb-84c6-d29d315c0fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:03.754596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d3367-ce0f-46fb-84c6-d29d315c0fa3 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:03.764350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 669/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:07.987383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaadc3-b9cf-45dc-8331-9d559319f9cb None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:07.987911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaadc3-b9cf-45dc-8331-9d559319f9cb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:07.987911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaadc3-b9cf-45dc-8331-9d559319f9cb None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:07.989780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 681/1350] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:07.994946 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fa64-56dc-4df9-a784-8aa43838d958 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:07.995331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fa64-56dc-4df9-a784-8aa43838d958 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:07.995654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fa64-56dc-4df9-a784-8aa43838d958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:08.013220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e790fa64-56dc-4df9-a784-8aa43838d958 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:08.014396 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e790fa64-56dc-4df9-a784-8aa43838d958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:08.022217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 670/1351] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:08.046074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaadc3-b9cf-45dc-8331-9d559319f9cb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:08.058175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaadc3-b9cf-45dc-8331-9d559319f9cb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:08.062623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537b2b0-5a21-40e7-a19b-2ca1f01a3f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:08.063263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537b2b0-5a21-40e7-a19b-2ca1f01a3f25 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:08.063612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537b2b0-5a21-40e7-a19b-2ca1f01a3f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:08.063895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537b2b0-5a21-40e7-a19b-2ca1f01a3f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:08.064642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537b2b0-5a21-40e7-a19b-2ca1f01a3f25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:08.066507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537b2b0-5a21-40e7-a19b-2ca1f01a3f25 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:08.080105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 682/1352] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:28:08 2022] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:28:10.303519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b95ca-198c-4679-90af-e5639d7a0f89 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:10.304092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b95ca-198c-4679-90af-e5639d7a0f89 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:10.304092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b95ca-198c-4679-90af-e5639d7a0f89 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:10.305851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 671/1353] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:10.311070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeedb0-08ab-45f8-a6c6-eb8596c5dd67 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:10.311525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeedb0-08ab-45f8-a6c6-eb8596c5dd67 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:10.311675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faeedb0-08ab-45f8-a6c6-eb8596c5dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:10.328816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6faeedb0-08ab-45f8-a6c6-eb8596c5dd67 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:10.330035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6faeedb0-08ab-45f8-a6c6-eb8596c5dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:10.337890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 683/1354] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:10.372872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b95ca-198c-4679-90af-e5639d7a0f89 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:10.391368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b95ca-198c-4679-90af-e5639d7a0f89 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:10.396650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c5d5-9d67-4edd-bcb7-63dda685c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:10.397504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c5d5-9d67-4edd-bcb7-63dda685c638 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:10.397788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c5d5-9d67-4edd-bcb7-63dda685c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:10.398067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c5d5-9d67-4edd-bcb7-63dda685c638 admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:10.399278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494c5d5-9d67-4edd-bcb7-63dda685c638 admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:10.401127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494c5d5-9d67-4edd-bcb7-63dda685c638 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:10.403014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 672/1355] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:28:10 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:28:10.414946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faeedb0-08ab-45f8-a6c6-eb8596c5dd67 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:10.424318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faeedb0-08ab-45f8-a6c6-eb8596c5dd67 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:10.427927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfc8f9-72f0-4c96-97c5-4853f6c5ebd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:10.428630 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfc8f9-72f0-4c96-97c5-4853f6c5ebd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:10.428984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfc8f9-72f0-4c96-97c5-4853f6c5ebd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:10.429331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfc8f9-72f0-4c96-97c5-4853f6c5ebd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:10.438051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfc8f9-72f0-4c96-97c5-4853f6c5ebd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:10.439552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfc8f9-72f0-4c96-97c5-4853f6c5ebd5 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:10.448740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 684/1356] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:13.364031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d20263-0940-49fa-a623-b7930b40be7c None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:13.364587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d20263-0940-49fa-a623-b7930b40be7c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:13.364587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d20263-0940-49fa-a623-b7930b40be7c None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:13.366393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 673/1357] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:13.372151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbea206-14d1-438b-be7b-fb303671fb93 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:13.372564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbea206-14d1-438b-be7b-fb303671fb93 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:13.372713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbea206-14d1-438b-be7b-fb303671fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:13.396229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-dbbea206-14d1-438b-be7b-fb303671fb93 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:13.397435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dbbea206-14d1-438b-be7b-fb303671fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:13.409887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 685/1358] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:13.457629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d20263-0940-49fa-a623-b7930b40be7c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:13.469979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d20263-0940-49fa-a623-b7930b40be7c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:13.473513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51844fb8-21f7-4b55-a80a-d7cbd7a7eeba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:13.474139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844fb8-21f7-4b55-a80a-d7cbd7a7eeba service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:13.474421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844fb8-21f7-4b55-a80a-d7cbd7a7eeba service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:13.474696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844fb8-21f7-4b55-a80a-d7cbd7a7eeba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:13.483989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51844fb8-21f7-4b55-a80a-d7cbd7a7eeba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:13.485429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51844fb8-21f7-4b55-a80a-d7cbd7a7eeba service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:13.494699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 674/1359] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:28:17.747242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307078-f285-4bdb-8868-c52c4860d5f4 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:17.747782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307078-f285-4bdb-8868-c52c4860d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:17.747874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307078-f285-4bdb-8868-c52c4860d5f4 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:17.749596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 686/1360] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:17.755054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48949-4af8-4d53-ae63-29f99b3e3f54 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:17.755586 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48949-4af8-4d53-ae63-29f99b3e3f54 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:17.755781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c48949-4af8-4d53-ae63-29f99b3e3f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:17.775305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-96c48949-4af8-4d53-ae63-29f99b3e3f54 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:17.776697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-96c48949-4af8-4d53-ae63-29f99b3e3f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:17.785549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 675/1361] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:17.823631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307078-f285-4bdb-8868-c52c4860d5f4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:17.834557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307078-f285-4bdb-8868-c52c4860d5f4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:17.838205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c8897-6ce2-4b64-ad2b-4a4db008524e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:17.838853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c8897-6ce2-4b64-ad2b-4a4db008524e service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:17.839135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c8897-6ce2-4b64-ad2b-4a4db008524e service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:17.839439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c8897-6ce2-4b64-ad2b-4a4db008524e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:17.852036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c8897-6ce2-4b64-ad2b-4a4db008524e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:17.853507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c8897-6ce2-4b64-ad2b-4a4db008524e service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:17.864329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 687/1362] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:22.864383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bafad-53f9-4c7a-8773-cfde2d2462b7 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:22.865249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bafad-53f9-4c7a-8773-cfde2d2462b7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:22.865697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bafad-53f9-4c7a-8773-cfde2d2462b7 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:22.868313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 676/1363] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:28:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:22.880425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154e40-d657-4ddf-b046-b745c7507402 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:22.880884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154e40-d657-4ddf-b046-b745c7507402 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:22.881266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154e40-d657-4ddf-b046-b745c7507402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:22.957148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a9154e40-d657-4ddf-b046-b745c7507402 None None] MFA Rules not processed for user `28c7f1498d7e4ef79977166d285e5e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:22.958677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a9154e40-d657-4ddf-b046-b745c7507402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:23.031937 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 688/1364] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:28:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:27.258948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed77e-2139-4153-92c0-e5a27ecfa11c None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:27.259863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed77e-2139-4153-92c0-e5a27ecfa11c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:27.260151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed77e-2139-4153-92c0-e5a27ecfa11c None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:27.262454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 677/1365] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:27.268364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb62b-47b6-4799-ac87-eb1757d0da18 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:27.269087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb62b-47b6-4799-ac87-eb1757d0da18 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:27.269087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb62b-47b6-4799-ac87-eb1757d0da18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:27.291940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fb8fb62b-47b6-4799-ac87-eb1757d0da18 None None] MFA Rules not processed for user `28c7f1498d7e4ef79977166d285e5e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:27.293457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fb8fb62b-47b6-4799-ac87-eb1757d0da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:27.303614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 689/1366] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:28:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:28.783111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae490-e038-41ba-88d3-7cfdbe86e21d None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:28.783635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae490-e038-41ba-88d3-7cfdbe86e21d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:28.783635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bae490-e038-41ba-88d3-7cfdbe86e21d None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:28.785397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 678/1367] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:28.790320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc9b72-85c6-43a5-9b16-619d9f2af2f6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:28.790739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc9b72-85c6-43a5-9b16-619d9f2af2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:28.790875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc9b72-85c6-43a5-9b16-619d9f2af2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:28.809292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a6bc9b72-85c6-43a5-9b16-619d9f2af2f6 None None] MFA Rules not processed for user `28c7f1498d7e4ef79977166d285e5e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:28.810476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a6bc9b72-85c6-43a5-9b16-619d9f2af2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:28.819298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 690/1368] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:28:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:28:32.613804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47f593-6383-4e4e-98a0-b5ece9da23c7 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:32.614316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47f593-6383-4e4e-98a0-b5ece9da23c7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:32.614316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47f593-6383-4e4e-98a0-b5ece9da23c7 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:32.616200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 679/1369] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:32.621319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b8da-634b-4bad-b63b-7b3a6abc15e8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:32.621736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b8da-634b-4bad-b63b-7b3a6abc15e8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:32.621876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b8da-634b-4bad-b63b-7b3a6abc15e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:32.639462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1a70b8da-634b-4bad-b63b-7b3a6abc15e8 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:32.640631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1a70b8da-634b-4bad-b63b-7b3a6abc15e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:32.648429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 691/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:32.702634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8d42-236b-4794-af2d-7d8f2dddf840 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:32.703208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8d42-236b-4794-af2d-7d8f2dddf840 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:32.703762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a8d42-236b-4794-af2d-7d8f2dddf840 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:32.706049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 680/1371] 10.222.0.60 () {54 vars in 961 bytes} [Mon Feb 7 20:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:32.711133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b5282-5359-4684-8361-d6a65364b284 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:32.711448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b5282-5359-4684-8361-d6a65364b284 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:32.711739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b5282-5359-4684-8361-d6a65364b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:32.761640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-492b5282-5359-4684-8361-d6a65364b284 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:32.762832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-492b5282-5359-4684-8361-d6a65364b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:32.844328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 692/1372] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Feb 7 20:28:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:32.852231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8d42-236b-4794-af2d-7d8f2dddf840 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:32.885089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a8d42-236b-4794-af2d-7d8f2dddf840 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:32.892973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea63c-2470-4542-837d-ef28cb6f69b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:32.893621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea63c-2470-4542-837d-ef28cb6f69b4 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:32.893904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea63c-2470-4542-837d-ef28cb6f69b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:32.894314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea63c-2470-4542-837d-ef28cb6f69b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:32.904580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea63c-2470-4542-837d-ef28cb6f69b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:32.906437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea63c-2470-4542-837d-ef28cb6f69b4 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:32.916913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 681/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:35.333600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd23fbd-de62-4bf2-8d42-145c2d8f55f9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:35.334581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd23fbd-de62-4bf2-8d42-145c2d8f55f9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:35.335064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd23fbd-de62-4bf2-8d42-145c2d8f55f9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:35.342666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f445-c0e6-4476-8e3a-30ca942f407a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:35.343556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f445-c0e6-4476-8e3a-30ca942f407a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:35.344036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6f445-c0e6-4476-8e3a-30ca942f407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:35.345587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 693/1374] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:35.362755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-41e6f445-c0e6-4476-8e3a-30ca942f407a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:35.364346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-41e6f445-c0e6-4476-8e3a-30ca942f407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:35.380354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 682/1375] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:28:35.419186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd23fbd-de62-4bf2-8d42-145c2d8f55f9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:35.434347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd23fbd-de62-4bf2-8d42-145c2d8f55f9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:35.439864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89616d-b23a-467a-8acd-be1bf3c99500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:35.440606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89616d-b23a-467a-8acd-be1bf3c99500 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:35.441010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89616d-b23a-467a-8acd-be1bf3c99500 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:35.441399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89616d-b23a-467a-8acd-be1bf3c99500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:35.450326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89616d-b23a-467a-8acd-be1bf3c99500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:35.452060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89616d-b23a-467a-8acd-be1bf3c99500 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:35.461620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 694/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:37.987609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcb78b-136e-4d62-a1ae-f34edf81436e None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:37.988642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcb78b-136e-4d62-a1ae-f34edf81436e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:37.989076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcb78b-136e-4d62-a1ae-f34edf81436e None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:37.992444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 683/1377] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:38.001959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510a94b-39d5-487f-b834-e84f39746872 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:38.002883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510a94b-39d5-487f-b834-e84f39746872 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:38.003370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510a94b-39d5-487f-b834-e84f39746872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:38.022398 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2510a94b-39d5-487f-b834-e84f39746872 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:38.023990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2510a94b-39d5-487f-b834-e84f39746872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:38.033196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 695/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:38.077901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7b5b-905d-45a0-8690-ee9789ff556e None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:38.078192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7b5b-905d-45a0-8690-ee9789ff556e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:38.078473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7b5b-905d-45a0-8690-ee9789ff556e None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:38.080271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 684/1379] 10.222.0.60 () {54 vars in 961 bytes} [Mon Feb 7 20:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:38.085483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e337f-a5d7-4dc2-87f6-577a1695fa78 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:38.085773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e337f-a5d7-4dc2-87f6-577a1695fa78 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:38.086053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e337f-a5d7-4dc2-87f6-577a1695fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:38.104444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d28e337f-a5d7-4dc2-87f6-577a1695fa78 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:38.106277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d28e337f-a5d7-4dc2-87f6-577a1695fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:38.115662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 696/1380] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Feb 7 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:38.123227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7b5b-905d-45a0-8690-ee9789ff556e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:38.137406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7b5b-905d-45a0-8690-ee9789ff556e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:38.142762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4504ad-d729-489c-b490-5fb2657c10ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:38.143383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4504ad-d729-489c-b490-5fb2657c10ba service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:38.143691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4504ad-d729-489c-b490-5fb2657c10ba service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:38.143967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4504ad-d729-489c-b490-5fb2657c10ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:38.152326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4504ad-d729-489c-b490-5fb2657c10ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:38.154183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4504ad-d729-489c-b490-5fb2657c10ba service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:38.163256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 685/1381] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:40.413825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352c4b7-7292-4fde-8708-2e180615378e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:40.414377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352c4b7-7292-4fde-8708-2e180615378e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:40.414377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352c4b7-7292-4fde-8708-2e180615378e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:40.416184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 697/1382] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:40.422540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ce593-e04d-430c-ae5a-1412d07c30a2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:40.423077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ce593-e04d-430c-ae5a-1412d07c30a2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:40.423077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ce593-e04d-430c-ae5a-1412d07c30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:40.442523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-eb4ce593-e04d-430c-ae5a-1412d07c30a2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:40.443779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-eb4ce593-e04d-430c-ae5a-1412d07c30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:40.452142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 686/1383] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:40.496894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352c4b7-7292-4fde-8708-2e180615378e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:40.510973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352c4b7-7292-4fde-8708-2e180615378e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:40.516746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0240c-e4a7-4dad-9b90-4e7d5b4f972a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:40.517439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0240c-e4a7-4dad-9b90-4e7d5b4f972a service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:40.517883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0240c-e4a7-4dad-9b90-4e7d5b4f972a service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:40.518167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0240c-e4a7-4dad-9b90-4e7d5b4f972a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:40.526922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0240c-e4a7-4dad-9b90-4e7d5b4f972a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:40.528898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0240c-e4a7-4dad-9b90-4e7d5b4f972a service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:40.538648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 698/1384] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:40.708485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f8e1-c530-486a-9e57-0ae37d5044d8 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:40.708688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f8e1-c530-486a-9e57-0ae37d5044d8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:40.709043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f8e1-c530-486a-9e57-0ae37d5044d8 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:40.710990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 687/1385] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:40.718170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45b1a-be2d-4a0d-b969-a3e87ff1513b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:40.718771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45b1a-be2d-4a0d-b969-a3e87ff1513b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:40.719359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45b1a-be2d-4a0d-b969-a3e87ff1513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:40.743838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-61b45b1a-be2d-4a0d-b969-a3e87ff1513b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:40.745110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-61b45b1a-be2d-4a0d-b969-a3e87ff1513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:40.755445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 699/1386] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:41.006369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58da6a-9479-449f-94b4-3b555d16ac00 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:41.006878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58da6a-9479-449f-94b4-3b555d16ac00 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:41.007257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58da6a-9479-449f-94b4-3b555d16ac00 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:41.009322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 688/1387] 10.222.0.60 () {54 vars in 963 bytes} [Mon Feb 7 20:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:41.014248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166b21-0b77-4735-9a29-64717dee4af7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:41.014642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166b21-0b77-4735-9a29-64717dee4af7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:41.015026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166b21-0b77-4735-9a29-64717dee4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:41.064326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d2166b21-0b77-4735-9a29-64717dee4af7 None None] MFA Rules not processed for user `98cad98b2dc54f97a4d72b53b0946802`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:41.065696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d2166b21-0b77-4735-9a29-64717dee4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:41.123921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 700/1388] 10.222.0.60 () {58 vars in 1060 bytes} [Mon Feb 7 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:41.131904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58da6a-9479-449f-94b4-3b555d16ac00 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:41.143144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58da6a-9479-449f-94b4-3b555d16ac00 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:41.146587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec875-0c18-40f7-bfba-7c78791f65e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:41.147244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec875-0c18-40f7-bfba-7c78791f65e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:41.147571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec875-0c18-40f7-bfba-7c78791f65e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:41.148012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec875-0c18-40f7-bfba-7c78791f65e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:41.157177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec875-0c18-40f7-bfba-7c78791f65e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:41.158588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec875-0c18-40f7-bfba-7c78791f65e9 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:41.168312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 689/1389] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:42.800401 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8ba9-d69d-49e9-a23d-ff7160f9d753 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:42.800837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8ba9-d69d-49e9-a23d-ff7160f9d753 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:42.800956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8ba9-d69d-49e9-a23d-ff7160f9d753 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:42.802764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 701/1390] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:42.808686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69f129-145c-41c9-bc36-bded147c035b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:42.808686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69f129-145c-41c9-bc36-bded147c035b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:42.809128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69f129-145c-41c9-bc36-bded147c035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:42.827340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7f69f129-145c-41c9-bc36-bded147c035b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:42.828606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7f69f129-145c-41c9-bc36-bded147c035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:42.836573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 690/1391] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:42.884451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb8ba9-d69d-49e9-a23d-ff7160f9d753 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:42.902162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb8ba9-d69d-49e9-a23d-ff7160f9d753 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:42.908555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186f9c5-5f92-4239-8dd2-09a541c383e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:42.909048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186f9c5-5f92-4239-8dd2-09a541c383e3 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:42.909340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186f9c5-5f92-4239-8dd2-09a541c383e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:42.909626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186f9c5-5f92-4239-8dd2-09a541c383e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:42.918491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186f9c5-5f92-4239-8dd2-09a541c383e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:42.920133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186f9c5-5f92-4239-8dd2-09a541c383e3 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:42.930177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 702/1392] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:45.186107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38d728-abe0-43b4-b60b-9c841bdb1144 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:45.187152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38d728-abe0-43b4-b60b-9c841bdb1144 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:45.187675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38d728-abe0-43b4-b60b-9c841bdb1144 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:45.193114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 691/1393] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:45.195215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef8dc1-8e1f-4df1-915f-ef318aa26ddc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:45.195692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef8dc1-8e1f-4df1-915f-ef318aa26ddc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:45.195812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef8dc1-8e1f-4df1-915f-ef318aa26ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:45.215347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-82ef8dc1-8e1f-4df1-915f-ef318aa26ddc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:45.217001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-82ef8dc1-8e1f-4df1-915f-ef318aa26ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:45.226743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 703/1394] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:45.271422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38d728-abe0-43b4-b60b-9c841bdb1144 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:45.287061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38d728-abe0-43b4-b60b-9c841bdb1144 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:45.293063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2a9c-7d1a-4cbe-8cc5-3ca911aa0571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:45.293943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2a9c-7d1a-4cbe-8cc5-3ca911aa0571 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:45.294441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2a9c-7d1a-4cbe-8cc5-3ca911aa0571 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:45.294926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2a9c-7d1a-4cbe-8cc5-3ca911aa0571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:45.304182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2a9c-7d1a-4cbe-8cc5-3ca911aa0571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:45.305977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2a9c-7d1a-4cbe-8cc5-3ca911aa0571 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:45.325461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 692/1395] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:47.615247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77603b0-a71d-4665-824e-e8bf66f31176 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:47.616142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77603b0-a71d-4665-824e-e8bf66f31176 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:47.616425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77603b0-a71d-4665-824e-e8bf66f31176 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:47.618240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 704/1396] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:47.624044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0abba-d4c4-4ffb-87b9-098422f78557 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:47.624517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0abba-d4c4-4ffb-87b9-098422f78557 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:47.624794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0abba-d4c4-4ffb-87b9-098422f78557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:47.644307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-75e0abba-d4c4-4ffb-87b9-098422f78557 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:47.645600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-75e0abba-d4c4-4ffb-87b9-098422f78557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:47.655508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 693/1397] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:47.699121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77603b0-a71d-4665-824e-e8bf66f31176 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:47.714654 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77603b0-a71d-4665-824e-e8bf66f31176 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:47.720340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aa1ad-8201-4236-940c-2c5a45c86ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:47.721087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aa1ad-8201-4236-940c-2c5a45c86ff6 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:47.721513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aa1ad-8201-4236-940c-2c5a45c86ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:47.721875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aa1ad-8201-4236-940c-2c5a45c86ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:47.731064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67aa1ad-8201-4236-940c-2c5a45c86ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:47.732788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67aa1ad-8201-4236-940c-2c5a45c86ff6 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:47.742420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 705/1398] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:49.965256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c0fc-44c5-4ec7-876b-38807cb0e2c2 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:49.965850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c0fc-44c5-4ec7-876b-38807cb0e2c2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:49.966028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c0fc-44c5-4ec7-876b-38807cb0e2c2 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:49.967770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 694/1399] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:49.973319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc5c59-8636-47a6-ad7c-082af28ad948 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:49.973790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc5c59-8636-47a6-ad7c-082af28ad948 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:49.973898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc5c59-8636-47a6-ad7c-082af28ad948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:49.991566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-98cc5c59-8636-47a6-ad7c-082af28ad948 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:49.993021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-98cc5c59-8636-47a6-ad7c-082af28ad948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:50.001516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 706/1400] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:28:50.045122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435c0fc-44c5-4ec7-876b-38807cb0e2c2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:50.063094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435c0fc-44c5-4ec7-876b-38807cb0e2c2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:50.070411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b53942-8a8a-47aa-8a4e-84f7ba5449b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:50.071569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b53942-8a8a-47aa-8a4e-84f7ba5449b8 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:50.071934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b53942-8a8a-47aa-8a4e-84f7ba5449b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:50.072288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b53942-8a8a-47aa-8a4e-84f7ba5449b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:50.083027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b53942-8a8a-47aa-8a4e-84f7ba5449b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:50.085118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b53942-8a8a-47aa-8a4e-84f7ba5449b8 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:50.097019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 695/1401] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:52.382368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903f47-4b28-4b5a-9a50-9cfab0aaeb7f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:52.382961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903f47-4b28-4b5a-9a50-9cfab0aaeb7f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:52.383064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903f47-4b28-4b5a-9a50-9cfab0aaeb7f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:52.386100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 707/1402] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:52.391952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1064d7-cd65-470d-8b70-cc8faa576ea7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:52.392382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1064d7-cd65-470d-8b70-cc8faa576ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:52.392683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1064d7-cd65-470d-8b70-cc8faa576ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:52.415813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0e1064d7-cd65-470d-8b70-cc8faa576ea7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:52.417467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0e1064d7-cd65-470d-8b70-cc8faa576ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:52.427761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 696/1403] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:52.470263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22903f47-4b28-4b5a-9a50-9cfab0aaeb7f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:52.484856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22903f47-4b28-4b5a-9a50-9cfab0aaeb7f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:52.490361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde8243-0fc0-4c0d-9080-4bbb4b474741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:52.490986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde8243-0fc0-4c0d-9080-4bbb4b474741 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:52.491265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde8243-0fc0-4c0d-9080-4bbb4b474741 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:52.491577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde8243-0fc0-4c0d-9080-4bbb4b474741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:52.499824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde8243-0fc0-4c0d-9080-4bbb4b474741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:52.501393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde8243-0fc0-4c0d-9080-4bbb4b474741 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:52.511029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 708/1404] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:54.810275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfedaca-c4c0-4656-acaa-4450ee27f86f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:54.810853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfedaca-c4c0-4656-acaa-4450ee27f86f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:54.810853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfedaca-c4c0-4656-acaa-4450ee27f86f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:54.812826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 697/1405] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:54.818295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5d9ed-fd56-4b86-8d4b-5b4abc310797 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:54.818696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5d9ed-fd56-4b86-8d4b-5b4abc310797 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:54.818851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5d9ed-fd56-4b86-8d4b-5b4abc310797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:54.836038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-07d5d9ed-fd56-4b86-8d4b-5b4abc310797 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:54.837211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-07d5d9ed-fd56-4b86-8d4b-5b4abc310797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:54.844856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 709/1406] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:28:54.888787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfedaca-c4c0-4656-acaa-4450ee27f86f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:54.902525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfedaca-c4c0-4656-acaa-4450ee27f86f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:54.908112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436737d-ef6d-4fd6-be30-975976209492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:54.908740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436737d-ef6d-4fd6-be30-975976209492 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:54.909021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436737d-ef6d-4fd6-be30-975976209492 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:54.909299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436737d-ef6d-4fd6-be30-975976209492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:54.918057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436737d-ef6d-4fd6-be30-975976209492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:54.919768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436737d-ef6d-4fd6-be30-975976209492 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:54.929058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 698/1407] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:56.430833 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044f7c-5ba3-4487-a671-79fcf8888532 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:56.431372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044f7c-5ba3-4487-a671-79fcf8888532 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:56.431372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73044f7c-5ba3-4487-a671-79fcf8888532 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:56.433752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 710/1408] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:56.438998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce096f-3735-437d-ad45-6cc1d8cec484 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:56.439476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce096f-3735-437d-ad45-6cc1d8cec484 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:56.439619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce096f-3735-437d-ad45-6cc1d8cec484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:56.457450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-75ce096f-3735-437d-ad45-6cc1d8cec484 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:56.458633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-75ce096f-3735-437d-ad45-6cc1d8cec484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:56.466347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 699/1409] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:56.526530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb6b2b-035e-495c-bd2c-f493cb54f16e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:56.526826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb6b2b-035e-495c-bd2c-f493cb54f16e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:56.527106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb6b2b-035e-495c-bd2c-f493cb54f16e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:56.529190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 711/1410] 10.222.0.60 () {54 vars in 962 bytes} [Mon Feb 7 20:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:56.534502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045270e-43db-4dfc-afd0-1741af429208 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:56.534797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045270e-43db-4dfc-afd0-1741af429208 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:56.535079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045270e-43db-4dfc-afd0-1741af429208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:56.582794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6045270e-43db-4dfc-afd0-1741af429208 None None] MFA Rules not processed for user `94d4a2ed97744c9fad6b44b5835e260f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:56.584041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6045270e-43db-4dfc-afd0-1741af429208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:56.643052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 700/1411] 10.222.0.60 () {58 vars in 1059 bytes} [Mon Feb 7 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:56.650391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb6b2b-035e-495c-bd2c-f493cb54f16e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:56.661565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb6b2b-035e-495c-bd2c-f493cb54f16e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:56.665136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e70ed8-d360-4d25-a8ba-e7c606725b6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:56.665769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e70ed8-d360-4d25-a8ba-e7c606725b6a service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:56.666053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e70ed8-d360-4d25-a8ba-e7c606725b6a service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:56.666865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e70ed8-d360-4d25-a8ba-e7c606725b6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:56.675988 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e70ed8-d360-4d25-a8ba-e7c606725b6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:56.677413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e70ed8-d360-4d25-a8ba-e7c606725b6a service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:56.687453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 712/1412] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:57.098844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e4f00-0315-4343-b51b-baa49ad3b767 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:57.099205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e4f00-0315-4343-b51b-baa49ad3b767 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:57.099590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e4f00-0315-4343-b51b-baa49ad3b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:57.146514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0e6e4f00-0315-4343-b51b-baa49ad3b767 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:57.147736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0e6e4f00-0315-4343-b51b-baa49ad3b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:57.163553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a55de-0877-4e6a-9c9f-77087f5f616d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:57.163845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a55de-0877-4e6a-9c9f-77087f5f616d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:57.164145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a55de-0877-4e6a-9c9f-77087f5f616d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:57.165903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 713/1413] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:28:57.170925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c8ce-e014-45c7-8ecb-bc5f25ae0ed2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:57.171218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c8ce-e014-45c7-8ecb-bc5f25ae0ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:57.171535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c8ce-e014-45c7-8ecb-bc5f25ae0ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:57.188855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a569c8ce-e014-45c7-8ecb-bc5f25ae0ed2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:57.190316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a569c8ce-e014-45c7-8ecb-bc5f25ae0ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:57.199073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 714/1414] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:28:57.210100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 701/1415] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:57.242836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569c8ce-e014-45c7-8ecb-bc5f25ae0ed2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:57.255474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569c8ce-e014-45c7-8ecb-bc5f25ae0ed2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:57.255876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7e39-e85c-452f-b0a4-0e0ae3d975dc None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:57.256172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7e39-e85c-452f-b0a4-0e0ae3d975dc None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:57.256460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7e39-e85c-452f-b0a4-0e0ae3d975dc None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:57.258251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 702/1416] 10.222.0.60 () {54 vars in 942 bytes} [Mon Feb 7 20:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:28:57.261642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:57.262223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:57.262513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:57.262800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:57.264741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14170ec-92a9-4469-94be-f2ece63deea5 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:57.265066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14170ec-92a9-4469-94be-f2ece63deea5 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:57.265337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14170ec-92a9-4469-94be-f2ece63deea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:57.271702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:57.273305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:57.283918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 715/1417] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:28:57.321304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c14170ec-92a9-4469-94be-f2ece63deea5 None None] MFA Rules not processed for user `4db726cf28f948108256ecd707c33c85`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:57.323103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c14170ec-92a9-4469-94be-f2ece63deea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:57.397048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 703/1418] 10.222.0.60 () {58 vars in 1039 bytes} [Mon Feb 7 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:28:57.407302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:57.419273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7295e-4975-4ddf-8629-9234ec4de39c service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:57.424561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087c36c-d869-4bbe-a720-b04f152a9e7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:57.425306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087c36c-d869-4bbe-a720-b04f152a9e7f service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:57.425666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087c36c-d869-4bbe-a720-b04f152a9e7f service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:57.426019 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087c36c-d869-4bbe-a720-b04f152a9e7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:57.435897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087c36c-d869-4bbe-a720-b04f152a9e7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:57.437701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087c36c-d869-4bbe-a720-b04f152a9e7f service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:57.447068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 716/1419] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:28:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:28:59.539364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3dc7-1414-44aa-a121-99996d2ad9b6 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:59.539364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3dc7-1414-44aa-a121-99996d2ad9b6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:59.539364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3dc7-1414-44aa-a121-99996d2ad9b6 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:59.539364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 704/1420] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:28:59.546483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d44f2-5cff-4007-ab97-62d774a4bb75 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:59.547327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d44f2-5cff-4007-ab97-62d774a4bb75 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:59.547844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d44f2-5cff-4007-ab97-62d774a4bb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:59.566375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fe7d44f2-5cff-4007-ab97-62d774a4bb75 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:28:59.567644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe7d44f2-5cff-4007-ab97-62d774a4bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:28:59.575774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 717/1421] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:28:59.624451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3dc7-1414-44aa-a121-99996d2ad9b6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:28:59.639309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3dc7-1414-44aa-a121-99996d2ad9b6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:28:59.646854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f83b5-af76-443a-ab9e-1be3b497d4dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:28:59.647516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f83b5-af76-443a-ab9e-1be3b497d4dc service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:28:59.647822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f83b5-af76-443a-ab9e-1be3b497d4dc service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:28:59.648088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f83b5-af76-443a-ab9e-1be3b497d4dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:28:59.657323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f83b5-af76-443a-ab9e-1be3b497d4dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:28:59.658900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f83b5-af76-443a-ab9e-1be3b497d4dc service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:28:59.675183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 705/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:20.200674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b396282-a6a7-4ee0-b0dc-49c382228663 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:20.201306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b396282-a6a7-4ee0-b0dc-49c382228663 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:20.201306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b396282-a6a7-4ee0-b0dc-49c382228663 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:20.202990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 718/1423] 10.222.0.60 () {54 vars in 918 bytes} [Mon Feb 7 20:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:20.208617 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74d14-269e-4d7a-b7d5-98f98f290198 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:20.209067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74d14-269e-4d7a-b7d5-98f98f290198 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:20.209225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74d14-269e-4d7a-b7d5-98f98f290198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:20.226705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-96f74d14-269e-4d7a-b7d5-98f98f290198 None None] MFA Rules not processed for user `28c7f1498d7e4ef79977166d285e5e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:20.228434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-96f74d14-269e-4d7a-b7d5-98f98f290198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:20.236713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 706/1424] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Feb 7 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:20.251465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9bb8-72ac-44ec-85e2-60b57fb01811 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:20.251760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9bb8-72ac-44ec-85e2-60b57fb01811 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:20.252042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9bb8-72ac-44ec-85e2-60b57fb01811 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:20.253773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 719/1425] 10.222.0.60 () {54 vars in 918 bytes} [Mon Feb 7 20:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:20.258240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c5b1-d528-41fa-9470-2635c59fe282 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:20.258535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c5b1-d528-41fa-9470-2635c59fe282 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:20.258822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c5b1-d528-41fa-9470-2635c59fe282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:20.280662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6280c5b1-d528-41fa-9470-2635c59fe282 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:20.281847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6280c5b1-d528-41fa-9470-2635c59fe282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:20.291349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 707/1426] 10.222.0.60 () {58 vars in 1015 bytes} [Mon Feb 7 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:22.943498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b580b-3fed-4bd3-a925-5299585a8498 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:22.944048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b580b-3fed-4bd3-a925-5299585a8498 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:22.944048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b580b-3fed-4bd3-a925-5299585a8498 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:22.945799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 720/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:22.951341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a93d-db79-46a3-b7d0-9f313ae6186f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:22.951764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a93d-db79-46a3-b7d0-9f313ae6186f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:22.951999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a93d-db79-46a3-b7d0-9f313ae6186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:22.970782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-4837a93d-db79-46a3-b7d0-9f313ae6186f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:22.972022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4837a93d-db79-46a3-b7d0-9f313ae6186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:22.980899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 708/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:23.022730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b580b-3fed-4bd3-a925-5299585a8498 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:23.037048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b580b-3fed-4bd3-a925-5299585a8498 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:23.042472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b2565-953e-4e5c-9662-6ba7e1f67270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:23.043101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b2565-953e-4e5c-9662-6ba7e1f67270 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:23.043384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b2565-953e-4e5c-9662-6ba7e1f67270 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:23.043688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b2565-953e-4e5c-9662-6ba7e1f67270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:23.051497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b2565-953e-4e5c-9662-6ba7e1f67270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:23.053071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b2565-953e-4e5c-9662-6ba7e1f67270 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:23.062682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 721/1429] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:24.400566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753df9-387c-4fa7-8db6-1044b6bfc19a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:24.401138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753df9-387c-4fa7-8db6-1044b6bfc19a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:24.401138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05753df9-387c-4fa7-8db6-1044b6bfc19a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:24.403130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 709/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:24.408208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62e17-6bdb-4438-8230-86a418a1cb71 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:24.408593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62e17-6bdb-4438-8230-86a418a1cb71 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:24.408774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62e17-6bdb-4438-8230-86a418a1cb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:24.426559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-96f62e17-6bdb-4438-8230-86a418a1cb71 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:24.427765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-96f62e17-6bdb-4438-8230-86a418a1cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:24.435888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 722/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:24.596364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753df9-387c-4fa7-8db6-1044b6bfc19a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:24.610082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05753df9-387c-4fa7-8db6-1044b6bfc19a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:24.615266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95404e01-0647-4b6d-b752-a9d9df643759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:24.615914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95404e01-0647-4b6d-b752-a9d9df643759 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:24.616193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95404e01-0647-4b6d-b752-a9d9df643759 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:24.616464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95404e01-0647-4b6d-b752-a9d9df643759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:24.624714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95404e01-0647-4b6d-b752-a9d9df643759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:24.626282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95404e01-0647-4b6d-b752-a9d9df643759 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:24.635885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 710/1432] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:25.964064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246cc-0d27-4e5b-951f-7539295a2a8a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:25.964605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246cc-0d27-4e5b-951f-7539295a2a8a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:25.964605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246cc-0d27-4e5b-951f-7539295a2a8a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:25.966390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 723/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:25.971279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498fef-3f03-40b6-b2f9-13d44df41a8c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:25.971735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498fef-3f03-40b6-b2f9-13d44df41a8c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:25.971858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498fef-3f03-40b6-b2f9-13d44df41a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:25.990375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-8d498fef-3f03-40b6-b2f9-13d44df41a8c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:25.991653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8d498fef-3f03-40b6-b2f9-13d44df41a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:25.999627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 711/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:26.154341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977246cc-0d27-4e5b-951f-7539295a2a8a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:26.168202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977246cc-0d27-4e5b-951f-7539295a2a8a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:26.173489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a423b-7660-4905-8deb-e291d14935c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:26.174108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a423b-7660-4905-8deb-e291d14935c3 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:26.174388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a423b-7660-4905-8deb-e291d14935c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:26.174663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a423b-7660-4905-8deb-e291d14935c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:26.182900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a423b-7660-4905-8deb-e291d14935c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:26.184517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a423b-7660-4905-8deb-e291d14935c3 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:26.193700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 724/1435] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:27.511757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b158-0b58-4e1b-8d32-3b9a6186c3c3 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:27.512316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b158-0b58-4e1b-8d32-3b9a6186c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:27.512316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b158-0b58-4e1b-8d32-3b9a6186c3c3 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:27.514108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 712/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:27.519074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58240221-f826-43d9-97cd-f149add15fbb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:27.519504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58240221-f826-43d9-97cd-f149add15fbb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:27.519672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58240221-f826-43d9-97cd-f149add15fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:27.538063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-58240221-f826-43d9-97cd-f149add15fbb None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:27.539259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-58240221-f826-43d9-97cd-f149add15fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:27.547614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 725/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:27.698875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65b158-0b58-4e1b-8d32-3b9a6186c3c3 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:27.713528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65b158-0b58-4e1b-8d32-3b9a6186c3c3 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:27.718853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e3959-ad49-4222-8b43-f7baf97650e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:27.719514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e3959-ad49-4222-8b43-f7baf97650e2 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:27.719800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e3959-ad49-4222-8b43-f7baf97650e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:27.720078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e3959-ad49-4222-8b43-f7baf97650e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:27.727981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e3959-ad49-4222-8b43-f7baf97650e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:27.729561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e3959-ad49-4222-8b43-f7baf97650e2 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:27.738970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 713/1438] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:29.058012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597fd5b-e2e1-46fe-9005-c0942ac19539 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:29.058570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597fd5b-e2e1-46fe-9005-c0942ac19539 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:29.058570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597fd5b-e2e1-46fe-9005-c0942ac19539 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:29.060420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 726/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:29.065375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48fd9c-2d83-4a27-b977-d2ef35b16cbd None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:29.065756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48fd9c-2d83-4a27-b977-d2ef35b16cbd None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:29.066006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48fd9c-2d83-4a27-b977-d2ef35b16cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:29.084132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6b48fd9c-2d83-4a27-b977-d2ef35b16cbd None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:29.085322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6b48fd9c-2d83-4a27-b977-d2ef35b16cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:29.093112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 714/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:29.242603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597fd5b-e2e1-46fe-9005-c0942ac19539 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:29.257398 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597fd5b-e2e1-46fe-9005-c0942ac19539 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:29.262849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeae78-4b5a-42b9-b8d8-043a2775d378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:29.263505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeae78-4b5a-42b9-b8d8-043a2775d378 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:29.263793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeae78-4b5a-42b9-b8d8-043a2775d378 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:29.264070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeae78-4b5a-42b9-b8d8-043a2775d378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:29.272005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeae78-4b5a-42b9-b8d8-043a2775d378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:29.273574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aeae78-4b5a-42b9-b8d8-043a2775d378 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:29.282838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 727/1441] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:30.551988 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887286-3d7b-45bf-a9c5-a119c466465c None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:30.552554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887286-3d7b-45bf-a9c5-a119c466465c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:30.552554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887286-3d7b-45bf-a9c5-a119c466465c None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:30.554354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 715/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 20:29:30.559233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e311-2aea-4bcd-b105-9b2a208eca2e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:30.559657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e311-2aea-4bcd-b105-9b2a208eca2e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:30.559834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e311-2aea-4bcd-b105-9b2a208eca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:30.577217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a8f4e311-2aea-4bcd-b105-9b2a208eca2e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:30.578387 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a8f4e311-2aea-4bcd-b105-9b2a208eca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:30.586164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 728/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:30.737808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89887286-3d7b-45bf-a9c5-a119c466465c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:30.752044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89887286-3d7b-45bf-a9c5-a119c466465c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:30.757779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab0586-ea1e-4dc5-bfab-4bdedbf84736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:30.758973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab0586-ea1e-4dc5-bfab-4bdedbf84736 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:30.759259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab0586-ea1e-4dc5-bfab-4bdedbf84736 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:30.759577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab0586-ea1e-4dc5-bfab-4bdedbf84736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:30.767706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab0586-ea1e-4dc5-bfab-4bdedbf84736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:30.769281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab0586-ea1e-4dc5-bfab-4bdedbf84736 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:30.779311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 716/1444] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:32.049636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ba6d-cd38-4169-8748-7d1f9097d4fd None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:32.050195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ba6d-cd38-4169-8748-7d1f9097d4fd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:32.050195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ba6d-cd38-4169-8748-7d1f9097d4fd None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:32.052014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 729/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:32.057494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c813ce-49e2-462b-b8fa-bfe4938b4c53 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:32.057928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c813ce-49e2-462b-b8fa-bfe4938b4c53 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:32.058058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c813ce-49e2-462b-b8fa-bfe4938b4c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:32.076981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-70c813ce-49e2-462b-b8fa-bfe4938b4c53 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:32.078156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-70c813ce-49e2-462b-b8fa-bfe4938b4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:32.085791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 717/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:32.239728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ba6d-cd38-4169-8748-7d1f9097d4fd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:32.255174 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ba6d-cd38-4169-8748-7d1f9097d4fd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:32.260554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c085-6ba7-4f89-b02e-167da62fc00c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:32.261184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c085-6ba7-4f89-b02e-167da62fc00c service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:32.261464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c085-6ba7-4f89-b02e-167da62fc00c service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:32.261743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c085-6ba7-4f89-b02e-167da62fc00c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:32.270015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c085-6ba7-4f89-b02e-167da62fc00c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:32.271639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c085-6ba7-4f89-b02e-167da62fc00c service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:32.281127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 730/1447] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:33.535366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0a28-bed0-4e28-91fb-0cd5afec6c11 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:33.535941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0a28-bed0-4e28-91fb-0cd5afec6c11 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:33.535941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0a28-bed0-4e28-91fb-0cd5afec6c11 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:33.537694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 718/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:33.543095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2770-6f1e-4e67-81c9-7ded14cffee1 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:33.543549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2770-6f1e-4e67-81c9-7ded14cffee1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:33.543687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2770-6f1e-4e67-81c9-7ded14cffee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:33.561183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-491c2770-6f1e-4e67-81c9-7ded14cffee1 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:33.562369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-491c2770-6f1e-4e67-81c9-7ded14cffee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:33.570030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 731/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:33.721588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e0a28-bed0-4e28-91fb-0cd5afec6c11 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:33.735487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e0a28-bed0-4e28-91fb-0cd5afec6c11 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:33.740745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdac405-9c86-4202-bb02-ae8b6145b665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:33.741374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac405-9c86-4202-bb02-ae8b6145b665 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:33.741655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac405-9c86-4202-bb02-ae8b6145b665 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:33.741932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac405-9c86-4202-bb02-ae8b6145b665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:33.749818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdac405-9c86-4202-bb02-ae8b6145b665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:33.751409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdac405-9c86-4202-bb02-ae8b6145b665 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:33.760919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 719/1450] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:35.021745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245931a-e309-463a-bf6e-45050771432b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:35.022274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245931a-e309-463a-bf6e-45050771432b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:35.022363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245931a-e309-463a-bf6e-45050771432b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:35.024138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 732/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:35.029276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3ff15-7ac3-4f5b-afcb-1e0e1677715e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:35.029659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3ff15-7ac3-4f5b-afcb-1e0e1677715e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:35.029833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3ff15-7ac3-4f5b-afcb-1e0e1677715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:35.047620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-cfc3ff15-7ac3-4f5b-afcb-1e0e1677715e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:35.048802 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cfc3ff15-7ac3-4f5b-afcb-1e0e1677715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:35.056958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 720/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:35.206201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245931a-e309-463a-bf6e-45050771432b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:35.220931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245931a-e309-463a-bf6e-45050771432b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:35.226272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5cc4c-57ac-4db3-99de-a840163b1e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:35.227443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5cc4c-57ac-4db3-99de-a840163b1e9a service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:35.227728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5cc4c-57ac-4db3-99de-a840163b1e9a service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:35.228003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5cc4c-57ac-4db3-99de-a840163b1e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:35.236068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5cc4c-57ac-4db3-99de-a840163b1e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:35.237688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5cc4c-57ac-4db3-99de-a840163b1e9a service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:35.247871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 733/1453] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:37.340035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1358f-75ac-41b4-9460-a1c29c9aad12 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:37.340489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1358f-75ac-41b4-9460-a1c29c9aad12 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:37.340584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1358f-75ac-41b4-9460-a1c29c9aad12 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:37.342350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 721/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:37.347671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874510-d65c-4236-b4e7-3e025e9c955a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:37.348071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874510-d65c-4236-b4e7-3e025e9c955a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:37.348244 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874510-d65c-4236-b4e7-3e025e9c955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:37.366174 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-92874510-d65c-4236-b4e7-3e025e9c955a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:37.367355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-92874510-d65c-4236-b4e7-3e025e9c955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:37.375198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 734/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:37.414025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1358f-75ac-41b4-9460-a1c29c9aad12 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:37.424330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1358f-75ac-41b4-9460-a1c29c9aad12 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:37.427778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1c4b7-dc83-4c1e-a4e1-acdba75fd0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:37.428398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c4b7-dc83-4c1e-a4e1-acdba75fd0cc service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:37.428674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c4b7-dc83-4c1e-a4e1-acdba75fd0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:37.428951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c4b7-dc83-4c1e-a4e1-acdba75fd0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:37.437516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1c4b7-dc83-4c1e-a4e1-acdba75fd0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:37.438954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1c4b7-dc83-4c1e-a4e1-acdba75fd0cc service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:37.448404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 722/1456] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:39.899205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142ba6-8a83-43e9-b7f3-19755210f282 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:39.899743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142ba6-8a83-43e9-b7f3-19755210f282 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:39.899848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72142ba6-8a83-43e9-b7f3-19755210f282 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:39.901598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 735/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:39.907027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df688f5-75f7-4e37-a871-934d85dfadcf None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:39.907472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df688f5-75f7-4e37-a871-934d85dfadcf None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:39.907633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df688f5-75f7-4e37-a871-934d85dfadcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:39.925639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1df688f5-75f7-4e37-a871-934d85dfadcf None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:39.926808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1df688f5-75f7-4e37-a871-934d85dfadcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:39.935059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 723/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:39.974487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142ba6-8a83-43e9-b7f3-19755210f282 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:39.985459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72142ba6-8a83-43e9-b7f3-19755210f282 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:39.989014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0f8fd-e551-4d49-a418-3f351d50b010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:39.989647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f8fd-e551-4d49-a418-3f351d50b010 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:39.989931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f8fd-e551-4d49-a418-3f351d50b010 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:39.990212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f8fd-e551-4d49-a418-3f351d50b010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:39.999615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0f8fd-e551-4d49-a418-3f351d50b010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:40.001050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0f8fd-e551-4d49-a418-3f351d50b010 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:40.010175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 736/1459] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:42.497032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117807-6402-46b2-8e7f-95ae677dc568 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:42.497642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117807-6402-46b2-8e7f-95ae677dc568 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:42.497642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117807-6402-46b2-8e7f-95ae677dc568 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:42.499330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 724/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:42.504680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87ca6-b6e3-472b-9eda-2bec34c54843 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:42.505095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87ca6-b6e3-472b-9eda-2bec34c54843 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:42.505231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87ca6-b6e3-472b-9eda-2bec34c54843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:42.524193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1cd87ca6-b6e3-472b-9eda-2bec34c54843 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:42.525358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1cd87ca6-b6e3-472b-9eda-2bec34c54843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:42.533285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 737/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:29:42.571470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117807-6402-46b2-8e7f-95ae677dc568 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:42.581799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117807-6402-46b2-8e7f-95ae677dc568 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:42.585275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d1b43-e80b-4f60-839a-8450a9e4db52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:42.585901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d1b43-e80b-4f60-839a-8450a9e4db52 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:42.586181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d1b43-e80b-4f60-839a-8450a9e4db52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:42.586462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d1b43-e80b-4f60-839a-8450a9e4db52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:42.594978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d1b43-e80b-4f60-839a-8450a9e4db52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:42.596441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d1b43-e80b-4f60-839a-8450a9e4db52 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:42.605461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 725/1462] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:44.924595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d9884-1d54-4731-9a71-78739dd2f55c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:44.925125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d9884-1d54-4731-9a71-78739dd2f55c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:44.925125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d9884-1d54-4731-9a71-78739dd2f55c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:44.926920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 738/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:44.932860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dda8d-ba69-4dc0-9761-4a6d1ca1b7d9 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:44.933253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dda8d-ba69-4dc0-9761-4a6d1ca1b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:44.933441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dda8d-ba69-4dc0-9761-4a6d1ca1b7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:44.950839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-407dda8d-ba69-4dc0-9761-4a6d1ca1b7d9 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:44.952046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-407dda8d-ba69-4dc0-9761-4a6d1ca1b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:44.959740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 726/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:44.998201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d9884-1d54-4731-9a71-78739dd2f55c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:45.008743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d9884-1d54-4731-9a71-78739dd2f55c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:45.012431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67321f91-a86c-461c-9564-35add9bde127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:45.013071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67321f91-a86c-461c-9564-35add9bde127 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:45.013375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67321f91-a86c-461c-9564-35add9bde127 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:45.013675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67321f91-a86c-461c-9564-35add9bde127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:45.022612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67321f91-a86c-461c-9564-35add9bde127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:45.024155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67321f91-a86c-461c-9564-35add9bde127 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:45.033713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 739/1465] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:47.290487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce46f3-cbcc-4b90-99b0-0b389ca29a4c None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:47.291062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce46f3-cbcc-4b90-99b0-0b389ca29a4c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:47.291062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce46f3-cbcc-4b90-99b0-0b389ca29a4c None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:47.292834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 727/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:47.298077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ede6b-9a0c-49d7-9cdb-452f7ec4ab15 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:47.298474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ede6b-9a0c-49d7-9cdb-452f7ec4ab15 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:47.298638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ede6b-9a0c-49d7-9cdb-452f7ec4ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:47.316543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a41ede6b-9a0c-49d7-9cdb-452f7ec4ab15 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:47.317730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a41ede6b-9a0c-49d7-9cdb-452f7ec4ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:47.325421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 740/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:47.362856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce46f3-cbcc-4b90-99b0-0b389ca29a4c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:47.373959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce46f3-cbcc-4b90-99b0-0b389ca29a4c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:47.377480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6290ba3-0346-47f2-90c4-479e4daacfe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:47.378100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290ba3-0346-47f2-90c4-479e4daacfe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:47.378378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290ba3-0346-47f2-90c4-479e4daacfe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:47.378651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6290ba3-0346-47f2-90c4-479e4daacfe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:47.387365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6290ba3-0346-47f2-90c4-479e4daacfe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:47.388847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6290ba3-0346-47f2-90c4-479e4daacfe9 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:47.398028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 728/1468] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:49.625881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100a44-3a7a-403a-83b5-28af2273b8bc None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:49.626402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100a44-3a7a-403a-83b5-28af2273b8bc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:49.626402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100a44-3a7a-403a-83b5-28af2273b8bc None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:49.628171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 741/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:49.634109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d72e-fc59-4ea0-b2eb-34684a7b2111 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:49.634540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d72e-fc59-4ea0-b2eb-34684a7b2111 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:49.634648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d72e-fc59-4ea0-b2eb-34684a7b2111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:49.652896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1f54d72e-fc59-4ea0-b2eb-34684a7b2111 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:49.654066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1f54d72e-fc59-4ea0-b2eb-34684a7b2111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:49.661686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 729/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:49.699588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100a44-3a7a-403a-83b5-28af2273b8bc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:49.709849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100a44-3a7a-403a-83b5-28af2273b8bc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:49.714066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee605c-829a-4f28-a13f-6b10a2709d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:49.714717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee605c-829a-4f28-a13f-6b10a2709d44 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:49.714997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee605c-829a-4f28-a13f-6b10a2709d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:49.715267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee605c-829a-4f28-a13f-6b10a2709d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:49.723905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee605c-829a-4f28-a13f-6b10a2709d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:49.725321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee605c-829a-4f28-a13f-6b10a2709d44 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:49.734346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 742/1471] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:52.041641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417731-c439-4859-b784-4029c89cc957 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:52.042200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417731-c439-4859-b784-4029c89cc957 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:52.042302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417731-c439-4859-b784-4029c89cc957 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:52.044160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 730/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:52.049385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7141-1a9f-4059-823e-2e891be54da0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:52.049827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7141-1a9f-4059-823e-2e891be54da0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:52.049939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc7141-1a9f-4059-823e-2e891be54da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:52.067660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5adc7141-1a9f-4059-823e-2e891be54da0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:52.068842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5adc7141-1a9f-4059-823e-2e891be54da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:52.077017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 743/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:52.112897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8417731-c439-4859-b784-4029c89cc957 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:52.123842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8417731-c439-4859-b784-4029c89cc957 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:52.127298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c2db9-bc00-4a51-bdb3-4f2102f82839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:52.127954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c2db9-bc00-4a51-bdb3-4f2102f82839 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:52.128239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c2db9-bc00-4a51-bdb3-4f2102f82839 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:52.128521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c2db9-bc00-4a51-bdb3-4f2102f82839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:52.137802 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c2db9-bc00-4a51-bdb3-4f2102f82839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:52.139232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c2db9-bc00-4a51-bdb3-4f2102f82839 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:52.148355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 731/1474] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:54.403627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c9df-df3a-41b4-80cf-aaa08fa1e118 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:54.404210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c9df-df3a-41b4-80cf-aaa08fa1e118 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:54.404210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c9df-df3a-41b4-80cf-aaa08fa1e118 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:54.405936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 744/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:54.411241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc969db-aebe-4cf1-8170-1d7f5f567755 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:54.411701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc969db-aebe-4cf1-8170-1d7f5f567755 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:54.411845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc969db-aebe-4cf1-8170-1d7f5f567755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:54.429731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1bc969db-aebe-4cf1-8170-1d7f5f567755 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:54.430920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1bc969db-aebe-4cf1-8170-1d7f5f567755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:54.438680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 732/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:29:54.476200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c9df-df3a-41b4-80cf-aaa08fa1e118 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:54.487321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c9df-df3a-41b4-80cf-aaa08fa1e118 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:54.490916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088834-6757-4f74-979f-17804b8d5b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:54.491583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088834-6757-4f74-979f-17804b8d5b42 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:54.491865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088834-6757-4f74-979f-17804b8d5b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:54.492139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088834-6757-4f74-979f-17804b8d5b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:54.501074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088834-6757-4f74-979f-17804b8d5b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:54.502540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088834-6757-4f74-979f-17804b8d5b42 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:54.511637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 745/1477] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:29:56.718129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51471ab-07e9-4eab-87e0-806fce867b68 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:56.718690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51471ab-07e9-4eab-87e0-806fce867b68 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:56.718690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51471ab-07e9-4eab-87e0-806fce867b68 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:56.720535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 733/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:56.726209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279ce49-376c-4ef1-a06c-d4a463ba9e95 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:56.726600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279ce49-376c-4ef1-a06c-d4a463ba9e95 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:56.726774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279ce49-376c-4ef1-a06c-d4a463ba9e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:56.744834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1279ce49-376c-4ef1-a06c-d4a463ba9e95 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:56.746026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1279ce49-376c-4ef1-a06c-d4a463ba9e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:56.753825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 746/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:56.791157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51471ab-07e9-4eab-87e0-806fce867b68 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:56.801620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51471ab-07e9-4eab-87e0-806fce867b68 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:56.805619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6789274-b732-416a-8b6d-f7bcf3da3eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:56.806239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6789274-b732-416a-8b6d-f7bcf3da3eaa service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:56.806520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6789274-b732-416a-8b6d-f7bcf3da3eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:56.806798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6789274-b732-416a-8b6d-f7bcf3da3eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:56.815580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6789274-b732-416a-8b6d-f7bcf3da3eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:56.817010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6789274-b732-416a-8b6d-f7bcf3da3eaa service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:56.826898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 734/1480] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:29:59.034790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a2147-ed49-46ed-95f2-7da68ceac21a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:59.035338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a2147-ed49-46ed-95f2-7da68ceac21a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:59.035338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a2147-ed49-46ed-95f2-7da68ceac21a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:59.037165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 747/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:29:59.043217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0087-4370-4564-b854-8daae39bddea None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:59.043652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0087-4370-4564-b854-8daae39bddea None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:59.043801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0087-4370-4564-b854-8daae39bddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:59.061026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1b3c0087-4370-4564-b854-8daae39bddea None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:29:59.062204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1b3c0087-4370-4564-b854-8daae39bddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:29:59.069891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 735/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:29:59.107135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a2147-ed49-46ed-95f2-7da68ceac21a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:29:59.118088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a2147-ed49-46ed-95f2-7da68ceac21a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:29:59.121793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1e96b-97b0-452e-b47d-309bbdef1bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:29:59.122427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e96b-97b0-452e-b47d-309bbdef1bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:29:59.122733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e96b-97b0-452e-b47d-309bbdef1bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:29:59.123009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e96b-97b0-452e-b47d-309bbdef1bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:29:59.131889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1e96b-97b0-452e-b47d-309bbdef1bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:29:59.133851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1e96b-97b0-452e-b47d-309bbdef1bc1 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:29:59.142935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 748/1483] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:30:16.415191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc850f5c-b02b-4353-8927-08ec4765a784 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:16.415811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc850f5c-b02b-4353-8927-08ec4765a784 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:16.415811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc850f5c-b02b-4353-8927-08ec4765a784 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:16.417559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 736/1484] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:16.422751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634880e-1410-4142-aae5-c8e3f946b422 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:16.423145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634880e-1410-4142-aae5-c8e3f946b422 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:16.423318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634880e-1410-4142-aae5-c8e3f946b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:16.441273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d634880e-1410-4142-aae5-c8e3f946b422 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:16.442456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d634880e-1410-4142-aae5-c8e3f946b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:16.450189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 749/1485] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:16.498379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7c6f-11ab-44f7-9922-3d4d2c48018b None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:16.498901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7c6f-11ab-44f7-9922-3d4d2c48018b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:16.499362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7c6f-11ab-44f7-9922-3d4d2c48018b None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:16.501175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 737/1486] 10.222.0.60 () {54 vars in 962 bytes} [Mon Feb 7 20:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:16.506195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520f3e-2d4f-43f9-af2e-de0bf458f36b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:16.506488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520f3e-2d4f-43f9-af2e-de0bf458f36b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:16.506769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520f3e-2d4f-43f9-af2e-de0bf458f36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:16.524771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7e520f3e-2d4f-43f9-af2e-de0bf458f36b None None] MFA Rules not processed for user `94d4a2ed97744c9fad6b44b5835e260f`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:16.525959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7e520f3e-2d4f-43f9-af2e-de0bf458f36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:16.532594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 750/1487] 10.222.0.60 () {58 vars in 1059 bytes} [Mon Feb 7 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:16.540369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef7c6f-11ab-44f7-9922-3d4d2c48018b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:16.550629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef7c6f-11ab-44f7-9922-3d4d2c48018b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:16.554051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a6dbc-baed-4abb-9b91-0630257cf47c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:16.555236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a6dbc-baed-4abb-9b91-0630257cf47c service glance] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:16.555544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a6dbc-baed-4abb-9b91-0630257cf47c service glance] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:16.555825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a6dbc-baed-4abb-9b91-0630257cf47c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:16.564319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a6dbc-baed-4abb-9b91-0630257cf47c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:16.565744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a6dbc-baed-4abb-9b91-0630257cf47c service glance] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:16.574713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 738/1488] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:30:18.862747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9df4d-0d1b-45b7-9219-1b092b2a7029 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:18.863302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9df4d-0d1b-45b7-9219-1b092b2a7029 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:18.863302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9df4d-0d1b-45b7-9219-1b092b2a7029 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:18.865125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 751/1489] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:18.870498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5172-4173-4e40-a07f-6f5204014412 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:18.870963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5172-4173-4e40-a07f-6f5204014412 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:18.871066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d5172-4173-4e40-a07f-6f5204014412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:18.888919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-159d5172-4173-4e40-a07f-6f5204014412 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:18.890107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-159d5172-4173-4e40-a07f-6f5204014412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:18.897813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 739/1490] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:18.929436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9df4d-0d1b-45b7-9219-1b092b2a7029 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:18.941540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9df4d-0d1b-45b7-9219-1b092b2a7029 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:18.946383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fb08c-ba79-4045-8fc3-9e375836f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:18.947016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fb08c-ba79-4045-8fc3-9e375836f125 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:18.947297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fb08c-ba79-4045-8fc3-9e375836f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:18.947623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fb08c-ba79-4045-8fc3-9e375836f125 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:18.948373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fb08c-ba79-4045-8fc3-9e375836f125 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:18.950211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fb08c-ba79-4045-8fc3-9e375836f125 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:18.964367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 752/1491] 10.222.0.60 () {56 vars in 1108 bytes} [Mon Feb 7 20:30:18 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:30:21.187819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3516e-341f-4fb5-bc7e-69456d26a230 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:21.188331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3516e-341f-4fb5-bc7e-69456d26a230 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:21.188826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3516e-341f-4fb5-bc7e-69456d26a230 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:21.191057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 740/1492] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:21.196384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b6aa6-e325-497c-9747-3035987f1511 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:21.196802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b6aa6-e325-497c-9747-3035987f1511 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:21.196940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b6aa6-e325-497c-9747-3035987f1511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:21.214577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-718b6aa6-e325-497c-9747-3035987f1511 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:21.215771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-718b6aa6-e325-497c-9747-3035987f1511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:21.223523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 753/1493] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:21.265772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3516e-341f-4fb5-bc7e-69456d26a230 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:21.280337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3516e-341f-4fb5-bc7e-69456d26a230 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:21.285592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d477e-b1cf-40d2-8126-71e1b0b3d819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:21.286208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d477e-b1cf-40d2-8126-71e1b0b3d819 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:21.286493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d477e-b1cf-40d2-8126-71e1b0b3d819 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:21.286770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d477e-b1cf-40d2-8126-71e1b0b3d819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:21.295061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d477e-b1cf-40d2-8126-71e1b0b3d819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:21.296733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d477e-b1cf-40d2-8126-71e1b0b3d819 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:21.306028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 741/1494] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:30:23.672321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03cff-2996-4db6-ac04-bf7240c8324f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:23.672886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03cff-2996-4db6-ac04-bf7240c8324f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:23.672886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03cff-2996-4db6-ac04-bf7240c8324f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:23.674701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 754/1495] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:23.680516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1576-1753-40d6-b7ed-7bfe43a28db2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:23.680963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1576-1753-40d6-b7ed-7bfe43a28db2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:23.681068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1576-1753-40d6-b7ed-7bfe43a28db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:23.699432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-24dc1576-1753-40d6-b7ed-7bfe43a28db2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:23.700612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-24dc1576-1753-40d6-b7ed-7bfe43a28db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:23.708173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 742/1496] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:23.743784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03cff-2996-4db6-ac04-bf7240c8324f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:23.754077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03cff-2996-4db6-ac04-bf7240c8324f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:23.758074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec1e3b-6abf-4e5c-bc78-7eb1372ab3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:23.758695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1e3b-6abf-4e5c-bc78-7eb1372ab3ef service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:23.758980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1e3b-6abf-4e5c-bc78-7eb1372ab3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:23.759248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec1e3b-6abf-4e5c-bc78-7eb1372ab3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:23.767922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec1e3b-6abf-4e5c-bc78-7eb1372ab3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:23.769343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec1e3b-6abf-4e5c-bc78-7eb1372ab3ef service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:23.778584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 755/1497] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:30:26.025759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751c58a-a325-4ef0-8e74-066498494162 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:26.026317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751c58a-a325-4ef0-8e74-066498494162 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:26.026317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751c58a-a325-4ef0-8e74-066498494162 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:26.028364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 743/1498] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:26.033832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6883-e9e6-4373-8ddd-6f17939cc57c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:26.034284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6883-e9e6-4373-8ddd-6f17939cc57c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:26.034386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6883-e9e6-4373-8ddd-6f17939cc57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:26.052636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-764a6883-e9e6-4373-8ddd-6f17939cc57c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:26.053822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-764a6883-e9e6-4373-8ddd-6f17939cc57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:26.061589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 756/1499] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:26.098793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751c58a-a325-4ef0-8e74-066498494162 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:26.109800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751c58a-a325-4ef0-8e74-066498494162 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:26.113343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899bb72-dd2a-45a6-a65f-370368835802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:26.113964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899bb72-dd2a-45a6-a65f-370368835802 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:26.114247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899bb72-dd2a-45a6-a65f-370368835802 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:26.114526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899bb72-dd2a-45a6-a65f-370368835802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:26.123279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899bb72-dd2a-45a6-a65f-370368835802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:26.124677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899bb72-dd2a-45a6-a65f-370368835802 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:26.134227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 744/1500] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:30:28.447669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ea5d2-1547-4afe-b476-9d25d9e7d295 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:28.448166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ea5d2-1547-4afe-b476-9d25d9e7d295 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:28.448166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ea5d2-1547-4afe-b476-9d25d9e7d295 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:28.449945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 757/1501] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:28.455222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386649-9883-4c24-978f-2c8092485bcd None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:28.455665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386649-9883-4c24-978f-2c8092485bcd None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:28.455831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef386649-9883-4c24-978f-2c8092485bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:28.473547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ef386649-9883-4c24-978f-2c8092485bcd None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:28.474990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ef386649-9883-4c24-978f-2c8092485bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:28.485905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 745/1502] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:28.522105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ea5d2-1547-4afe-b476-9d25d9e7d295 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:28.534814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ea5d2-1547-4afe-b476-9d25d9e7d295 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:28.539885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab2c2-b581-4f0d-9a6c-dff9740a162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:28.540731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab2c2-b581-4f0d-9a6c-dff9740a162e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:28.541010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab2c2-b581-4f0d-9a6c-dff9740a162e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:28.541288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab2c2-b581-4f0d-9a6c-dff9740a162e admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:28.542494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ab2c2-b581-4f0d-9a6c-dff9740a162e admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:28.544324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ab2c2-b581-4f0d-9a6c-dff9740a162e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:28.545994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 758/1503] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:30:28 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:30:28.558383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef386649-9883-4c24-978f-2c8092485bcd None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:28.567921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef386649-9883-4c24-978f-2c8092485bcd None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:28.571510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de1c89-35ff-43ad-939c-a9f66f010a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:28.572149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de1c89-35ff-43ad-939c-a9f66f010a96 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:28.572431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de1c89-35ff-43ad-939c-a9f66f010a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:28.572716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de1c89-35ff-43ad-939c-a9f66f010a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:28.582237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de1c89-35ff-43ad-939c-a9f66f010a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:28.583705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de1c89-35ff-43ad-939c-a9f66f010a96 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:28.593726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 746/1504] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:30:30.970969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e24f-952e-40c8-b27b-8f859bc158ed None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:30.971557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e24f-952e-40c8-b27b-8f859bc158ed None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:30.971557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57e24f-952e-40c8-b27b-8f859bc158ed None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:30.973373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 759/1505] 10.222.0.60 () {54 vars in 926 bytes} [Mon Feb 7 20:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:30:30.978788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b295-a68c-4ac5-865e-8947b659e2d2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:30.979205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b295-a68c-4ac5-865e-8947b659e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:30.979413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b295-a68c-4ac5-865e-8947b659e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:30.996886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-96b0b295-a68c-4ac5-865e-8947b659e2d2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:30:30.998075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-96b0b295-a68c-4ac5-865e-8947b659e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:30:31.005813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 747/1506] 10.222.0.60 () {58 vars in 1023 bytes} [Mon Feb 7 20:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:30:31.045842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57e24f-952e-40c8-b27b-8f859bc158ed None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:31.058520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57e24f-952e-40c8-b27b-8f859bc158ed None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:31.062903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ed48e-f852-42cd-98e5-9cc94cb63cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:31.063766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ed48e-f852-42cd-98e5-9cc94cb63cca admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:31.064048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ed48e-f852-42cd-98e5-9cc94cb63cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:31.064323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ed48e-f852-42cd-98e5-9cc94cb63cca admin admin] PATH_INFO: `/v3/projects/1fd85593742943409724ee224daef15b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:31.065491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ed48e-f852-42cd-98e5-9cc94cb63cca admin admin] RBAC: Authorizing `identity:get_project(project_id=1fd85593742943409724ee224daef15b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:31.067555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ed48e-f852-42cd-98e5-9cc94cb63cca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:31.069184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 760/1507] 10.222.0.60 () {56 vars in 1207 bytes} [Mon Feb 7 20:30:31 2022] GET /identity/v3/projects/1fd85593742943409724ee224daef15b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:30:31.080682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0b295-a68c-4ac5-865e-8947b659e2d2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:30:31.089631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0b295-a68c-4ac5-865e-8947b659e2d2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:30:31.093187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6bb47-32b7-4c05-adb1-8b449323b346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:30:31.095478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6bb47-32b7-4c05-adb1-8b449323b346 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:30:31.095793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6bb47-32b7-4c05-adb1-8b449323b346 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:30:31.096080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6bb47-32b7-4c05-adb1-8b449323b346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:30:31.105271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6bb47-32b7-4c05-adb1-8b449323b346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:30:31.106706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6bb47-32b7-4c05-adb1-8b449323b346 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:30:31.115899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 748/1508] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:31:51.588531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde942b-0e70-4047-b096-64f663b21a49 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.589123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde942b-0e70-4047-b096-64f663b21a49 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.589123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde942b-0e70-4047-b096-64f663b21a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.607750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9bde942b-0e70-4047-b096-64f663b21a49 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:31:51.608938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9bde942b-0e70-4047-b096-64f663b21a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:31:51.617697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 761/1509] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:31:51.625747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b99c9-74ea-4c4e-8722-26e96b3dc703 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.626215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b99c9-74ea-4c4e-8722-26e96b3dc703 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.626321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b99c9-74ea-4c4e-8722-26e96b3dc703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.643701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-fa8b99c9-74ea-4c4e-8722-26e96b3dc703 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:31:51.644816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fa8b99c9-74ea-4c4e-8722-26e96b3dc703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:31:51.652467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 749/1510] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:31:51.656936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde942b-0e70-4047-b096-64f663b21a49 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:51.666684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde942b-0e70-4047-b096-64f663b21a49 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:51.671098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:51.671782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.672065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.672340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.673071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:31:51.673375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:51.674951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:51.686853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 762/1511] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:31:51.694506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b99c9-74ea-4c4e-8722-26e96b3dc703 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:51.703197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b99c9-74ea-4c4e-8722-26e96b3dc703 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:51.707647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:51.708282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.708562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.708837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.710028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:51.711967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:51.748641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 750/1512] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:31:51 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:31:51.752772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:51.763083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea46f6-fdbe-47a9-aae3-3d492a89a585 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:51.822456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:51.823122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.823427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.823741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.824445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:51.826370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:51.845359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 763/1513] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:31:51 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:31:51.849630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:51.859698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33af7-11b8-4d75-9898-bd9515675a41 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:51.864234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:51.864885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.865170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.865997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.866737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:51.868383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:51.880945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 751/1514] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:31:51.885503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:51.895233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4658-ec70-42d5-a056-96792c80bb90 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:51.899830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed963a1-4a04-4737-be8a-5b836eddf11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:51.900476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed963a1-4a04-4737-be8a-5b836eddf11f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.900759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed963a1-4a04-4737-be8a-5b836eddf11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.901037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed963a1-4a04-4737-be8a-5b836eddf11f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.901776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed963a1-4a04-4737-be8a-5b836eddf11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:51.903400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed963a1-4a04-4737-be8a-5b836eddf11f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:51.916514 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 764/1515] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:31:51.920471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:51.930618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac72478-7054-46d9-b2b5-6cbecdf7ee72 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:51.935140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:51.936033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.936319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.936601 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] PATH_INFO: `/v3/projects/5f361926958e4bc5ad5d396d686c78b9/users/16f9eb0e343f47e79e46ab663dbb90e3/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:51.951252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f361926958e4bc5ad5d396d686c78b9, user_id=16f9eb0e343f47e79e46ab663dbb90e3, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:51.953918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:51.966687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 752/1516] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:31:51 2022] PUT /identity/v3/projects/5f361926958e4bc5ad5d396d686c78b9/users/16f9eb0e343f47e79e46ab663dbb90e3/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:31:51.979686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042339-985a-4772-a83b-30d9041f34e0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:51.979978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042339-985a-4772-a83b-30d9041f34e0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:51.980261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f042339-985a-4772-a83b-30d9041f34e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:52.006054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3f042339-985a-4772-a83b-30d9041f34e0 None None] MFA Rules not processed for user `16f9eb0e343f47e79e46ab663dbb90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:31:52.007266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3f042339-985a-4772-a83b-30d9041f34e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:31:52.069201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 765/1517] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:31:52.080077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:52.146494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eb94e-8173-4fb6-b355-866879436d54 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:52.152446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:52.153076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:52.153360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:52.153639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:52.161443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:52.163090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:52.171552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 753/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:31:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:31:52.237951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf623e3-f74c-4735-8de7-62ed368a6ebd None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:52.238246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf623e3-f74c-4735-8de7-62ed368a6ebd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:52.238541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf623e3-f74c-4735-8de7-62ed368a6ebd None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:52.240261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 766/1519] 10.222.0.60 () {52 vars in 829 bytes} [Mon Feb 7 20:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:31:52.244393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:52.304978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e21db-8bf3-4fcd-85c9-8f61250a7429 service nova] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:52.309706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:52.310568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:52.310854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:52.311134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] PATH_INFO: `/v3/users/16f9eb0e343f47e79e46ab663dbb90e3` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:52.312383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f9eb0e343f47e79e46ab663dbb90e3)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:52.313397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:31:52.313397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:31:52.313397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:31:52.314598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:52.376963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f9eb0e343f47e79e46ab663dbb90e3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:52.389378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f9eb0e343f47e79e46ab663dbb90e3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:52.409307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f9eb0e343f47e79e46ab663dbb90e3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:52.418335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f9eb0e343f47e79e46ab663dbb90e3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:52.418973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f9eb0e343f47e79e46ab663dbb90e3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:52.425220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 754/1520] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:31:52 2022] DELETE /identity/v3/users/16f9eb0e343f47e79e46ab663dbb90e3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:31:52.430200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e7df-9872-4558-b347-379310454025 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:52.430515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e7df-9872-4558-b347-379310454025 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:52.430792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e7df-9872-4558-b347-379310454025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:52.448268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e747e7df-9872-4558-b347-379310454025 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:31:52.449447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e747e7df-9872-4558-b347-379310454025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:31:52.504259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 767/1521] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:31:52.514215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:52.515667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:31:52.569881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572986af-a376-4d56-8842-9a50a3e2af2a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:52.573495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf4abf-7231-4320-8030-145698cb8685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:52.574131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4abf-7231-4320-8030-145698cb8685 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:52.574415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4abf-7231-4320-8030-145698cb8685 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:52.574696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4abf-7231-4320-8030-145698cb8685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:52.583384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf4abf-7231-4320-8030-145698cb8685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:52.584893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf4abf-7231-4320-8030-145698cb8685 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:52.594038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 755/1522] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:31:52.904905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e7df-9872-4558-b347-379310454025 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:31:52.906326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e747e7df-9872-4558-b347-379310454025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:31:52.918402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e7df-9872-4558-b347-379310454025 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:31:52.923427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:31:52.924501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:31:52.924971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:31:52.925305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] PATH_INFO: `/v3/projects/5f361926958e4bc5ad5d396d686c78b9` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:31:52.926452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f361926958e4bc5ad5d396d686c78b9)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:31:52.927534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:31:52.927534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:31:52.927534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:31:52.929459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:31:52.986905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f361926958e4bc5ad5d396d686c78b9', 'request_id': 'req-4e66fe80-3b76-4e19-a06b-93d810f55593'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:52.996985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f361926958e4bc5ad5d396d686c78b9', 'request_id': 'req-4e66fe80-3b76-4e19-a06b-93d810f55593'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:53.003053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f361926958e4bc5ad5d396d686c78b9', 'request_id': 'req-4e66fe80-3b76-4e19-a06b-93d810f55593'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:53.021255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] The token cache is being invalidate because project 5f361926958e4bc5ad5d396d686c78b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:31:53.021575 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:53.022331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4e66fe80-3b76-4e19-a06b-93d810f55593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:31:53.023887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 768/1523] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:31:52 2022] DELETE /identity/v3/projects/5f361926958e4bc5ad5d396d686c78b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:33:21.522280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dd50-56e5-4bc9-8b6f-5ec84906d2b7 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:21.522861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dd50-56e5-4bc9-8b6f-5ec84906d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:21.522861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dd50-56e5-4bc9-8b6f-5ec84906d2b7 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:21.524688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 756/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:21.529634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204381-1fdf-4cc5-ae79-c92a481a7985 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:21.530330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204381-1fdf-4cc5-ae79-c92a481a7985 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:21.530533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204381-1fdf-4cc5-ae79-c92a481a7985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:21.549218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-84204381-1fdf-4cc5-ae79-c92a481a7985 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:21.550476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-84204381-1fdf-4cc5-ae79-c92a481a7985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:21.606725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 769/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:33:21.762493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42dd50-56e5-4bc9-8b6f-5ec84906d2b7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:21.764100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9b42dd50-56e5-4bc9-8b6f-5ec84906d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:21.836078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42dd50-56e5-4bc9-8b6f-5ec84906d2b7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:21.841336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b73f8-2cb5-48a5-852a-7d75597c9769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:21.841972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b73f8-2cb5-48a5-852a-7d75597c9769 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:21.842255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b73f8-2cb5-48a5-852a-7d75597c9769 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:21.842532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b73f8-2cb5-48a5-852a-7d75597c9769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:21.854705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b73f8-2cb5-48a5-852a-7d75597c9769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:21.856507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b73f8-2cb5-48a5-852a-7d75597c9769 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:21.869571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 757/1526] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:21.946728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6cca-ea52-4dc2-af04-94ae33ba7ca7 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:21.947017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6cca-ea52-4dc2-af04-94ae33ba7ca7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:21.947301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe6cca-ea52-4dc2-af04-94ae33ba7ca7 None None] PATH_INFO: `/v3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:21.948647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 770/1527] 10.222.0.24 () {54 vars in 925 bytes} [Mon Feb 7 20:33:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:33:21.954781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209fbcc-4f4a-4211-8884-520090286900 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:21.955074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209fbcc-4f4a-4211-8884-520090286900 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:21.955355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209fbcc-4f4a-4211-8884-520090286900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:21.977609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2209fbcc-4f4a-4211-8884-520090286900 None None] MFA Rules not processed for user `28c7f1498d7e4ef79977166d285e5e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:21.978823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2209fbcc-4f4a-4211-8884-520090286900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:22.040085 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 758/1528] 10.222.0.24 () {58 vars in 1015 bytes} [Mon Feb 7 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:23.171855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3ad0-cc01-4a8a-ad90-177b37731710 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:23.172409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3ad0-cc01-4a8a-ad90-177b37731710 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:23.172409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3ad0-cc01-4a8a-ad90-177b37731710 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:23.174180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 771/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:23.179512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3539b-09f8-436d-900b-dcc4c98e7c39 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:23.179944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3539b-09f8-436d-900b-dcc4c98e7c39 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:23.180087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3539b-09f8-436d-900b-dcc4c98e7c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:23.198343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-85c3539b-09f8-436d-900b-dcc4c98e7c39 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:23.199597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-85c3539b-09f8-436d-900b-dcc4c98e7c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:23.207321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 759/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:23.360484 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee3ad0-cc01-4a8a-ad90-177b37731710 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:23.374425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee3ad0-cc01-4a8a-ad90-177b37731710 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:23.379809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750e01-d2fb-49e3-8dac-5192c7ce45e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:23.380440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750e01-d2fb-49e3-8dac-5192c7ce45e5 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:23.380725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750e01-d2fb-49e3-8dac-5192c7ce45e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:23.381004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750e01-d2fb-49e3-8dac-5192c7ce45e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:23.388932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750e01-d2fb-49e3-8dac-5192c7ce45e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:23.390517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750e01-d2fb-49e3-8dac-5192c7ce45e5 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:23.400492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 772/1531] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:25.894172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f3c9-c5f0-4858-9143-6006bc62914a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:25.894729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f3c9-c5f0-4858-9143-6006bc62914a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:25.894729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f3c9-c5f0-4858-9143-6006bc62914a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:25.896547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 760/1532] 10.222.0.60 () {54 vars in 960 bytes} [Mon Feb 7 20:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:25.901705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d001-104d-4d41-8a1d-0adbcfd393bb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:25.902145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d001-104d-4d41-8a1d-0adbcfd393bb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:25.902252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d001-104d-4d41-8a1d-0adbcfd393bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:25.920283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bf59d001-104d-4d41-8a1d-0adbcfd393bb None None] MFA Rules not processed for user `28c7f1498d7e4ef79977166d285e5e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:25.921471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bf59d001-104d-4d41-8a1d-0adbcfd393bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:25.930331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 773/1533] 10.222.0.60 () {58 vars in 1057 bytes} [Mon Feb 7 20:33:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:25.937369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05f3c9-c5f0-4858-9143-6006bc62914a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:25.950725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05f3c9-c5f0-4858-9143-6006bc62914a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:25.955547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532460d-5cc6-446f-a91f-34bde2db0168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c7f1498d7e4ef79977166d285e5e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:25.956164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532460d-5cc6-446f-a91f-34bde2db0168 service placement] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:25.956511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532460d-5cc6-446f-a91f-34bde2db0168 service placement] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:25.956787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532460d-5cc6-446f-a91f-34bde2db0168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:25.964735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532460d-5cc6-446f-a91f-34bde2db0168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:25.966298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532460d-5cc6-446f-a91f-34bde2db0168 service placement] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:25.975476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 761/1534] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:35.125326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be5b5-96b8-4ef1-880d-8f0996a9bb1f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:35.125841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be5b5-96b8-4ef1-880d-8f0996a9bb1f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:35.125841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be5b5-96b8-4ef1-880d-8f0996a9bb1f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:35.127590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 774/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:35.135115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b879-7a05-41ab-9433-c47ed08eb196 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:35.135562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b879-7a05-41ab-9433-c47ed08eb196 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:35.135760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b879-7a05-41ab-9433-c47ed08eb196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:35.153413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-41c4b879-7a05-41ab-9433-c47ed08eb196 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:35.154588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-41c4b879-7a05-41ab-9433-c47ed08eb196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:35.162689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 762/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:35.315077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be5b5-96b8-4ef1-880d-8f0996a9bb1f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:35.329083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be5b5-96b8-4ef1-880d-8f0996a9bb1f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:35.334359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6344f6-e177-4897-b380-4c1c08d0f31a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:35.334976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6344f6-e177-4897-b380-4c1c08d0f31a service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:35.335256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6344f6-e177-4897-b380-4c1c08d0f31a service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:35.335564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6344f6-e177-4897-b380-4c1c08d0f31a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:35.343289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6344f6-e177-4897-b380-4c1c08d0f31a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:35.344926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6344f6-e177-4897-b380-4c1c08d0f31a service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:35.354435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 775/1537] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:36.634943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6058-ee2e-41ef-b33c-c9e63ed845dd None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:36.635538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6058-ee2e-41ef-b33c-c9e63ed845dd None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:36.635538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6058-ee2e-41ef-b33c-c9e63ed845dd None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:36.637319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 763/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:36.642100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351bb7-87b3-4b01-ab3c-4c79ea2da767 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:36.642513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351bb7-87b3-4b01-ab3c-4c79ea2da767 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:36.642657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8351bb7-87b3-4b01-ab3c-4c79ea2da767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:36.660543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e8351bb7-87b3-4b01-ab3c-4c79ea2da767 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:36.661722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e8351bb7-87b3-4b01-ab3c-4c79ea2da767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:36.669354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 776/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 20:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:33:36.825253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6058-ee2e-41ef-b33c-c9e63ed845dd None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:36.839100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6058-ee2e-41ef-b33c-c9e63ed845dd None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:36.844401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd113c-1e21-48e1-bb9a-9b75365edbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:36.845026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd113c-1e21-48e1-bb9a-9b75365edbd4 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:36.845310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd113c-1e21-48e1-bb9a-9b75365edbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:36.845589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd113c-1e21-48e1-bb9a-9b75365edbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:36.854189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd113c-1e21-48e1-bb9a-9b75365edbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:36.855799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd113c-1e21-48e1-bb9a-9b75365edbd4 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:36.865640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 764/1540] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:40.885818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288f3e0-d9cf-40eb-aa71-5d33cf512a54 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:40.886254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288f3e0-d9cf-40eb-aa71-5d33cf512a54 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:40.886363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288f3e0-d9cf-40eb-aa71-5d33cf512a54 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:40.888166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 777/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:40.893288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5128f6d-209d-4c39-828c-7188f70895a1 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:40.893741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5128f6d-209d-4c39-828c-7188f70895a1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:40.893839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5128f6d-209d-4c39-828c-7188f70895a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:40.911830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e5128f6d-209d-4c39-828c-7188f70895a1 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:40.913023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e5128f6d-209d-4c39-828c-7188f70895a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:40.920747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 765/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:40.959238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288f3e0-d9cf-40eb-aa71-5d33cf512a54 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:40.960989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b288f3e0-d9cf-40eb-aa71-5d33cf512a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:41.015462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288f3e0-d9cf-40eb-aa71-5d33cf512a54 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:41.019002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a264c12-8893-449e-a88e-bd24b67d3e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:41.019662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a264c12-8893-449e-a88e-bd24b67d3e1d service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:41.019947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a264c12-8893-449e-a88e-bd24b67d3e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:41.020223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a264c12-8893-449e-a88e-bd24b67d3e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:41.028805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a264c12-8893-449e-a88e-bd24b67d3e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:41.030480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a264c12-8893-449e-a88e-bd24b67d3e1d service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:41.039528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 778/1543] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:43.256535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8414d-64a5-4591-b401-ae6bd766e623 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:43.257117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8414d-64a5-4591-b401-ae6bd766e623 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:43.257117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8414d-64a5-4591-b401-ae6bd766e623 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:43.258857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 766/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:43.264256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf604-a50a-4bb9-86fb-4a76eb3295b4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:43.264694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf604-a50a-4bb9-86fb-4a76eb3295b4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:43.264838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf604-a50a-4bb9-86fb-4a76eb3295b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:43.284824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-707bf604-a50a-4bb9-86fb-4a76eb3295b4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:43.286028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-707bf604-a50a-4bb9-86fb-4a76eb3295b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:43.293845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 779/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:33:43.330444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8414d-64a5-4591-b401-ae6bd766e623 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:43.341147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8414d-64a5-4591-b401-ae6bd766e623 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:43.344923 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9a6d-8e78-4ad4-9dad-6b105047e1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:43.345580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9a6d-8e78-4ad4-9dad-6b105047e1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:43.345862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9a6d-8e78-4ad4-9dad-6b105047e1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:43.346136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9a6d-8e78-4ad4-9dad-6b105047e1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:43.354946 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9a6d-8e78-4ad4-9dad-6b105047e1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:43.356397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9a6d-8e78-4ad4-9dad-6b105047e1b2 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:43.366216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 767/1546] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:47.136743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f085a-0c91-49f5-a06a-46c33684202b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:47.137325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f085a-0c91-49f5-a06a-46c33684202b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:47.137325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f085a-0c91-49f5-a06a-46c33684202b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:47.139096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 780/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:47.145396 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3385af-3b58-462f-b3f0-e977a35bcc43 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:47.145854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3385af-3b58-462f-b3f0-e977a35bcc43 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:47.145956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3385af-3b58-462f-b3f0-e977a35bcc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:47.164637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ce3385af-3b58-462f-b3f0-e977a35bcc43 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:47.165812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ce3385af-3b58-462f-b3f0-e977a35bcc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:47.173408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 768/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:47.425038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f085a-0c91-49f5-a06a-46c33684202b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:47.426631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e05f085a-0c91-49f5-a06a-46c33684202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:47.480868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f085a-0c91-49f5-a06a-46c33684202b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:47.484440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c7cc-bf28-416a-a071-3f1022f70735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:47.485088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7cc-bf28-416a-a071-3f1022f70735 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:47.485369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7cc-bf28-416a-a071-3f1022f70735 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:47.485646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7cc-bf28-416a-a071-3f1022f70735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:47.495141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910c7cc-bf28-416a-a071-3f1022f70735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:47.496641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910c7cc-bf28-416a-a071-3f1022f70735 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:47.506487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 781/1549] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:33:49.742054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293b401-33c6-40dd-8c54-8522feccdae1 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:49.742610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293b401-33c6-40dd-8c54-8522feccdae1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:49.742610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293b401-33c6-40dd-8c54-8522feccdae1 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:49.744345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 769/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 20:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:49.749524 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a15d-c546-4f49-9351-99adae48ac33 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:49.749976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a15d-c546-4f49-9351-99adae48ac33 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:49.750103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a15d-c546-4f49-9351-99adae48ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:49.767924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b6c6a15d-c546-4f49-9351-99adae48ac33 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:49.769702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b6c6a15d-c546-4f49-9351-99adae48ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:49.777506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 782/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 20:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:50.037930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930b4a7-aba6-40a6-b35d-2918708db8e9 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:50.038133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930b4a7-aba6-40a6-b35d-2918708db8e9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:50.038408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930b4a7-aba6-40a6-b35d-2918708db8e9 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:50.040212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 770/1552] 10.222.0.60 () {54 vars in 963 bytes} [Mon Feb 7 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:33:50.045284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b28c0-07ad-4bc6-ac21-a0f0151e33e4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:50.045581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b28c0-07ad-4bc6-ac21-a0f0151e33e4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:50.045867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b28c0-07ad-4bc6-ac21-a0f0151e33e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:50.063711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1f1b28c0-07ad-4bc6-ac21-a0f0151e33e4 None None] MFA Rules not processed for user `98cad98b2dc54f97a4d72b53b0946802`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:33:50.064911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1f1b28c0-07ad-4bc6-ac21-a0f0151e33e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:33:50.071267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 783/1553] 10.222.0.60 () {58 vars in 1060 bytes} [Mon Feb 7 20:33:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:33:50.078332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930b4a7-aba6-40a6-b35d-2918708db8e9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:33:50.089032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930b4a7-aba6-40a6-b35d-2918708db8e9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:33:50.092508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b984c26-6606-4695-b4e2-3703ec95dd9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:33:50.093174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984c26-6606-4695-b4e2-3703ec95dd9a service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:33:50.093456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984c26-6606-4695-b4e2-3703ec95dd9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:33:50.093735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984c26-6606-4695-b4e2-3703ec95dd9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:33:50.103020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b984c26-6606-4695-b4e2-3703ec95dd9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:33:50.104472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b984c26-6606-4695-b4e2-3703ec95dd9a service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:33:50.114071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 771/1554] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:12.207849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab1d6-7bf7-4e99-a29f-83b281e522c2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.208472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab1d6-7bf7-4e99-a29f-83b281e522c2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.208472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab1d6-7bf7-4e99-a29f-83b281e522c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.236034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b10ab1d6-7bf7-4e99-a29f-83b281e522c2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:12.237245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b10ab1d6-7bf7-4e99-a29f-83b281e522c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:12.245841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 784/1555] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:12.256552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6489a-ee6e-44bb-a552-615b0997a81a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.257116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6489a-ee6e-44bb-a552-615b0997a81a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.257116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6489a-ee6e-44bb-a552-615b0997a81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.285755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-cea6489a-ee6e-44bb-a552-615b0997a81a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:12.286959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cea6489a-ee6e-44bb-a552-615b0997a81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:12.307407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 772/1556] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:12.312071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab1d6-7bf7-4e99-a29f-83b281e522c2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.322919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab1d6-7bf7-4e99-a29f-83b281e522c2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.332477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.333166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.333516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.333805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.334572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:12.334911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.340617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.353578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 785/1557] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:12.363462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6489a-ee6e-44bb-a552-615b0997a81a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.377969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6489a-ee6e-44bb-a552-615b0997a81a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.388190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28561c3-07e7-4f25-bf12-0397b8aed592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.388859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28561c3-07e7-4f25-bf12-0397b8aed592 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.389142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28561c3-07e7-4f25-bf12-0397b8aed592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.389423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28561c3-07e7-4f25-bf12-0397b8aed592 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.390134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28561c3-07e7-4f25-bf12-0397b8aed592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.392111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28561c3-07e7-4f25-bf12-0397b8aed592 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.433685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 773/1558] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:12.438406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.455733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bf27b-a255-4ed4-947a-bd6df9de58b2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.489694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2475220-2944-481f-82d4-babec62045b5 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.489904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2475220-2944-481f-82d4-babec62045b5 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.490172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2475220-2944-481f-82d4-babec62045b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.528418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f2475220-2944-481f-82d4-babec62045b5 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:12.530031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f2475220-2944-481f-82d4-babec62045b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:12.530803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.532043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.532333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.532713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.533439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.535375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.551788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 774/1559] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:12.561787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729aee-8b71-4dee-b4b7-d3a97e89ed32 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.562110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729aee-8b71-4dee-b4b7-d3a97e89ed32 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.562396 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729aee-8b71-4dee-b4b7-d3a97e89ed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.570008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 786/1560] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:12.574346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.584884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60deeb-c35b-459e-a510-d581179fd106 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.596452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a4729aee-8b71-4dee-b4b7-d3a97e89ed32 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:12.597886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a4729aee-8b71-4dee-b4b7-d3a97e89ed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:12.601195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.602021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.602312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.602584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.603359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.605089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.621387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 775/1561] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:12.629886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 787/1562] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:12.631925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729aee-8b71-4dee-b4b7-d3a97e89ed32 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.633983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.646900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465283-1ced-4ea9-b53f-1781ab6eaa8f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.647628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729aee-8b71-4dee-b4b7-d3a97e89ed32 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.653778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.654460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.654993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.655288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.656075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.657967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.661141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.661818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.662108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.662374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.663123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:12.663459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.665078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.673807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 788/1563] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:12.678477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.689489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 776/1564] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:12.689986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc7f86-1824-4902-8d41-c6bb46787eeb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.698538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.702149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba6085-dbd9-4882-a12a-8da5d0e24060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.703063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6085-dbd9-4882-a12a-8da5d0e24060 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.703936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6085-dbd9-4882-a12a-8da5d0e24060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.704221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba6085-dbd9-4882-a12a-8da5d0e24060 admin admin] PATH_INFO: `/v3/projects/b690e585dc49422d8cce052c120e70c7/users/1a13b0b8fb82455daa18e673646d8556/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.719134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ae41f-175e-487c-84b0-7986e8387eac admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.732687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13597066-0e3a-4348-9a18-44fd4187e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.733371 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597066-0e3a-4348-9a18-44fd4187e5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.733661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597066-0e3a-4348-9a18-44fd4187e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.734001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13597066-0e3a-4348-9a18-44fd4187e5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.734959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13597066-0e3a-4348-9a18-44fd4187e5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.738286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13597066-0e3a-4348-9a18-44fd4187e5b9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.747606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba6085-dbd9-4882-a12a-8da5d0e24060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b690e585dc49422d8cce052c120e70c7, user_id=1a13b0b8fb82455daa18e673646d8556, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.750848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba6085-dbd9-4882-a12a-8da5d0e24060 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.778083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 789/1565] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:12 2022] PUT /identity/v3/projects/b690e585dc49422d8cce052c120e70c7/users/1a13b0b8fb82455daa18e673646d8556/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:12.779376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90337c-1866-4cac-b85d-727cb388e954 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.779693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90337c-1866-4cac-b85d-727cb388e954 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.780273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90337c-1866-4cac-b85d-727cb388e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.800452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 777/1566] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:12.801824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50d5d-e9cf-4c7a-b12f-64ffa46775da None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.802115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50d5d-e9cf-4c7a-b12f-64ffa46775da None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.802397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50d5d-e9cf-4c7a-b12f-64ffa46775da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.819675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5d90337c-1866-4cac-b85d-727cb388e954 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:12.820855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5d90337c-1866-4cac-b85d-727cb388e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:12.862600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5ef50d5d-e9cf-4c7a-b12f-64ffa46775da None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:12.864352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5ef50d5d-e9cf-4c7a-b12f-64ffa46775da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:12.953938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 790/1567] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:12.954904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90337c-1866-4cac-b85d-727cb388e954 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:12.965361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90337c-1866-4cac-b85d-727cb388e954 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:12.970855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b26be-c880-4461-a8cd-8701cbcc18b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:12.971576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b26be-c880-4461-a8cd-8701cbcc18b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.971879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b26be-c880-4461-a8cd-8701cbcc18b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.972145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b26be-c880-4461-a8cd-8701cbcc18b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:12.973082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b26be-c880-4461-a8cd-8701cbcc18b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:12.974994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b26be-c880-4461-a8cd-8701cbcc18b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:12.987580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 778/1568] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:12.989559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22c040-9480-44d3-8761-e5ac1bd46e08 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:12.990012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22c040-9480-44d3-8761-e5ac1bd46e08 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:12.990432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22c040-9480-44d3-8761-e5ac1bd46e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.002448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 791/1569] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.005574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b564dc-b0dd-4ee3-bb5a-ea20468c2421 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.005574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b564dc-b0dd-4ee3-bb5a-ea20468c2421 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.005574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b564dc-b0dd-4ee3-bb5a-ea20468c2421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.011087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ab22c040-9480-44d3-8761-e5ac1bd46e08 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.012419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ab22c040-9480-44d3-8761-e5ac1bd46e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.021768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 779/1570] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.023023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c70e4-f0d3-49cb-aab9-f5507b32d73d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.023311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c70e4-f0d3-49cb-aab9-f5507b32d73d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.023614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c70e4-f0d3-49cb-aab9-f5507b32d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.033463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c7b564dc-b0dd-4ee3-bb5a-ea20468c2421 None None] MFA Rules not processed for user `1a13b0b8fb82455daa18e673646d8556`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.034679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c7b564dc-b0dd-4ee3-bb5a-ea20468c2421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.041489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5e1c70e4-f0d3-49cb-aab9-f5507b32d73d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.042731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5e1c70e4-f0d3-49cb-aab9-f5507b32d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.054652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 780/1571] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.056087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fff2c-64f2-49de-a78a-c7af17e4d22d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.056501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fff2c-64f2-49de-a78a-c7af17e4d22d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.056976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fff2c-64f2-49de-a78a-c7af17e4d22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.075360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-4e8fff2c-64f2-49de-a78a-c7af17e4d22d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.076589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4e8fff2c-64f2-49de-a78a-c7af17e4d22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.086536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 781/1572] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.088762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1938e-298f-4862-9fe4-9b066d86f772 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.089175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1938e-298f-4862-9fe4-9b066d86f772 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.089461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1938e-298f-4862-9fe4-9b066d86f772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.097986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 792/1573] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.099276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb95c-e514-4668-8bf5-d28f5fe3b5d4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.099604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb95c-e514-4668-8bf5-d28f5fe3b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.099895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb95c-e514-4668-8bf5-d28f5fe3b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.111595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-60b1938e-298f-4862-9fe4-9b066d86f772 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.112780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-60b1938e-298f-4862-9fe4-9b066d86f772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.119365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-82cbb95c-e514-4668-8bf5-d28f5fe3b5d4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.120554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-82cbb95c-e514-4668-8bf5-d28f5fe3b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.120821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 782/1574] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.121635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1938e-298f-4862-9fe4-9b066d86f772 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.129849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 793/1575] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.131109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16ac1-0d27-427b-86d7-25f0fc815402 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.131416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16ac1-0d27-427b-86d7-25f0fc815402 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.131640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1938e-298f-4862-9fe4-9b066d86f772 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.131759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16ac1-0d27-427b-86d7-25f0fc815402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.136569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a862c17-1494-4491-a532-3d4ebfeb85b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.137672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a862c17-1494-4491-a532-3d4ebfeb85b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.137672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a862c17-1494-4491-a532-3d4ebfeb85b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.137872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a862c17-1494-4491-a532-3d4ebfeb85b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.138498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a862c17-1494-4491-a532-3d4ebfeb85b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.140160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a862c17-1494-4491-a532-3d4ebfeb85b0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.153266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 783/1576] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:13.153445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bdb16ac1-0d27-427b-86d7-25f0fc815402 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.153547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e45fe-94ae-4c64-918b-261e87f7e4a6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.153547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e45fe-94ae-4c64-918b-261e87f7e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.153710 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bdb16ac1-0d27-427b-86d7-25f0fc815402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.153801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e45fe-94ae-4c64-918b-261e87f7e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.160031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 794/1577] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.163562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f48d20-b8db-4d60-85c8-749e82cec00e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.163562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f48d20-b8db-4d60-85c8-749e82cec00e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.163562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f48d20-b8db-4d60-85c8-749e82cec00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.169900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-416e45fe-94ae-4c64-918b-261e87f7e4a6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.171095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-416e45fe-94ae-4c64-918b-261e87f7e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.179519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 784/1578] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.181228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-14f48d20-b8db-4d60-85c8-749e82cec00e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.182389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-14f48d20-b8db-4d60-85c8-749e82cec00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.183742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e45fe-94ae-4c64-918b-261e87f7e4a6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.190944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 795/1579] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.191734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f48d20-b8db-4d60-85c8-749e82cec00e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.193458 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e45fe-94ae-4c64-918b-261e87f7e4a6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.198830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7801a-a672-4d8e-888b-e8a3e69580f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.199627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7801a-a672-4d8e-888b-e8a3e69580f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.199914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7801a-a672-4d8e-888b-e8a3e69580f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.200194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7801a-a672-4d8e-888b-e8a3e69580f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.200932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7801a-a672-4d8e-888b-e8a3e69580f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:13.201242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7801a-a672-4d8e-888b-e8a3e69580f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.202876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7801a-a672-4d8e-888b-e8a3e69580f3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.214076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 785/1580] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:13.215367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f6a1-3f10-4fec-8d2c-34c84af5639e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.215693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f6a1-3f10-4fec-8d2c-34c84af5639e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.215975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f6a1-3f10-4fec-8d2c-34c84af5639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.232982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d593f6a1-3f10-4fec-8d2c-34c84af5639e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.234195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d593f6a1-3f10-4fec-8d2c-34c84af5639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.242669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 786/1581] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.243409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593f6a1-3f10-4fec-8d2c-34c84af5639e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.244270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f48d20-b8db-4d60-85c8-749e82cec00e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.248055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.248711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.249002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.249277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.253348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593f6a1-3f10-4fec-8d2c-34c84af5639e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.257860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a741b-55cd-4165-982e-271eef74ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.258429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.258537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a741b-55cd-4165-982e-271eef74ab95 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.258764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a741b-55cd-4165-982e-271eef74ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.259045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a741b-55cd-4165-982e-271eef74ab95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.259772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.259885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a741b-55cd-4165-982e-271eef74ab95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:13.260109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a741b-55cd-4165-982e-271eef74ab95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.261692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a741b-55cd-4165-982e-271eef74ab95 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.268841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 796/1582] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:13.269730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.280245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 787/1583] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:13.280245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d14c6-9fe6-4a28-bad0-62d7b6bca920 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.280245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d14c6-9fe6-4a28-bad0-62d7b6bca920 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.280245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d14c6-9fe6-4a28-bad0-62d7b6bca920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.288123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d77ae-6e20-44de-a7c6-e567f111f12a service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.293080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.293732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.293853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-856d14c6-9fe6-4a28-bad0-62d7b6bca920 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.294036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.294247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.294909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-856d14c6-9fe6-4a28-bad0-62d7b6bca920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.295021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.296693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.303612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 788/1584] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:13.307257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d14c6-9fe6-4a28-bad0-62d7b6bca920 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.307838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 797/1585] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:13.308530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.316653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d14c6-9fe6-4a28-bad0-62d7b6bca920 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.317958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e469ea0-0c89-4c8c-bd2a-5da9373ae541 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.321340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.322024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.322306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.322458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.322577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.323083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.323336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:13.323493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.323661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.323768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.324380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:13.324687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.325268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.326335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.337540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 789/1586] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:13.345547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 798/1587] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:13.345547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.347190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.350235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac7893-7cf4-436e-9e16-b4d45495a57c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.354956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.355641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.355926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.356206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.356916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.358222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205647-76dc-4f43-9c6e-0731b06e96ca admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.358865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.363375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.364128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.364924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.365202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.365944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:13.366978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.368621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.381010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 790/1588] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:13.384570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.388608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 799/1589] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.389485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.396544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9ab69-dbf8-45ae-b7b1-3f3e28f5f5fd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.451022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a0e89-330b-4a50-a6b1-b483e998fd0c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.451269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.451966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.452251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.452527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.453264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.455232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.456444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.457171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.457605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.458004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.458878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:13.459254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.460950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.480992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 800/1590] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:13.480992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.484230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e2deb-2415-411a-91b3-281a24f03f32 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.490043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.490467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 791/1591] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.491367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.494053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.494340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.494618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] PATH_INFO: `/v3/projects/38080e0b28114c1ba467265ac6b1aa7a/users/cb5d234a3b9e46a5bdf6fd9b66c6267d/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.510359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38080e0b28114c1ba467265ac6b1aa7a, user_id=cb5d234a3b9e46a5bdf6fd9b66c6267d, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.513033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.530504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 801/1592] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:13 2022] PUT /identity/v3/projects/38080e0b28114c1ba467265ac6b1aa7a/users/cb5d234a3b9e46a5bdf6fd9b66c6267d/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:13.532211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.577789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cd8f2-69af-4309-b7ff-09c4627b4c8b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.600427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d8099-6bb2-4112-9a91-6e4c02a2a40a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.605775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.606471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.606705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.606982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.607721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.610522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.637526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 802/1593] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.638483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.653398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.654451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.655205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.655732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.657272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.659537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.686543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 792/1594] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/projects => generated 401 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.687415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.700979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b57f5-454f-4707-8522-965e3157e826 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.751242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22bdfc-1e03-4400-b501-4152d6c28f2f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.756119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.756793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.757078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.757331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.758029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.760001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.761170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.761776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.762061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.762347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.763054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.765133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.785486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 793/1595] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.786488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.797793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 803/1596] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.797793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.816326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92668d69-1def-4572-8e69-6a873371391a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.861457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e283b3-8512-49b7-9f85-f6896347fc1d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.866491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54340-ee1e-4c69-9bf4-3a1bd0154c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.870393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54340-ee1e-4c69-9bf4-3a1bd0154c1a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.870393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54340-ee1e-4c69-9bf4-3a1bd0154c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.870393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54340-ee1e-4c69-9bf4-3a1bd0154c1a admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.870393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf54340-ee1e-4c69-9bf4-3a1bd0154c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.870914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf54340-ee1e-4c69-9bf4-3a1bd0154c1a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.887293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:13.888083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.888394 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.888647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.889407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:13.892222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:13.901397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 804/1597] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.902769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78ab4-0142-4057-9bb2-98b115292aff None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:13.903066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78ab4-0142-4057-9bb2-98b115292aff None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:13.903348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78ab4-0142-4057-9bb2-98b115292aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:13.929800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 794/1598] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:13.929800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:13.934038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2da78ab4-0142-4057-9bb2-98b115292aff None None] MFA Rules not processed for user `cb5d234a3b9e46a5bdf6fd9b66c6267d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:13.935409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2da78ab4-0142-4057-9bb2-98b115292aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:13.994132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d7719-07ca-4651-a5a6-c5f53d188cc7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:13.999225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.000038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.000949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.001446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.002321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.004391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.004559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 805/1599] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:14.008792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78ab4-0142-4057-9bb2-98b115292aff None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.020368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78ab4-0142-4057-9bb2-98b115292aff None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.025640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.026306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.026589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.026866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.030721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 795/1600] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:13 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:14.030868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.030994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.031099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.042140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67131998-de34-425d-817f-f9bf9fd4168f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.047050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.047885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.048168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.048443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.049182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.053851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 806/1601] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/users => generated 301 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:14.054003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.054103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.061299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 796/1602] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.061736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0b6a1-af38-43ca-b1dd-0cf6d87b0c22 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.062150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.067516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.068067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.068353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.068634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.069336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.071261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.071961 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbea1-51f5-4499-a541-a135308315f7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.076456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.077108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.077390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.077666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.078989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.080590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.092392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 807/1603] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:14.093025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 797/1604] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.093648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.095930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.103748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a48f4-16a0-479c-9dfa-5d380686abbb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.105284 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bbd9-3d17-4a7f-843a-a6246fba28c3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.108653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.109578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.109857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.110063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.110344 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.110513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.110785 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.111049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.111202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.111769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.113546 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.113674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.134736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 808/1605] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:14.135627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.141848 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 798/1606] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:14.142710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.148037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e42fb-eb94-4941-9176-5089d1680138 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.204219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2127d-ada2-4f00-960b-1af0311f1b5c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.204539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.205217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.205653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.205946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.206693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.208335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.208898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.209565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.209859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.210143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.210887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.212534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.217966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 809/1607] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.218784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.229578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 799/1608] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.230305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.233035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6617a-42c5-4539-a570-7c0f91d23002 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.237982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.238700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.238980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.239280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.240060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.240745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b40731-57a9-4526-bee1-4c43a32a12d2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.241663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.245393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.246044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.246391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.246675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.247441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.249069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.252555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 810/1609] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.253405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.259901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 800/1610] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.260624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.263628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e50d-beb1-4e62-b46e-f56dfe3f0bd7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.268885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.269527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.269810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.270084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.270812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ecb8c-d7c3-4bca-a876-4fece7f8539b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.270923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.272405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.275449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.276075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.276364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.276643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.277376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.279112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.282690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 811/1611] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.283762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.289837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 801/1612] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.290539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.294008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992663-6194-4b09-891f-cbf4c02136ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.298626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.299269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.299588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.299764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d964ae-3ea1-4d08-aeaf-8afee9c20683 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.299876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.300560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.302456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.304317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.304945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.305235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.305522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.306247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.307844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.319372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 802/1613] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.320200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.326910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 812/1614] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:14.326910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.332721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4c581-b3d0-4a18-94ae-1e3c6024012e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.334534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936427b-a2ab-466c-b8a0-b0d9b7e1263a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.337435 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.338080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.338367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.338649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.339127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.339379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.340010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.340297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.340579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] PATH_INFO: `/v3/projects/1920726293f94b09a11892df688f137b/users/97f892d00220472eaca2e132ddba2db8/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.340999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.354157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 803/1615] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.354157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.355421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1920726293f94b09a11892df688f137b, user_id=97f892d00220472eaca2e132ddba2db8, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.358209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.361731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a892f-0287-461e-9a9e-b9a7009b6d7c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.367374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.368055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.368345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.368622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.369355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.370939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.371596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 813/1616] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:14 2022] PUT /identity/v3/projects/1920726293f94b09a11892df688f137b/users/97f892d00220472eaca2e132ddba2db8/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:14.372372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.381988 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 804/1617] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.382783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.392039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e85b-19ac-45de-a323-7d9be21c1182 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.431607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39a1f3-ecdf-403c-891d-13b0059730d6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.436169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.437041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.437318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.437633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] PATH_INFO: `/v3/projects/65cf5264b1da4554b2269d6ae291ebe5/users/a21a81cf49444a5ab66b6b83e518007a/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.445322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.445979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.446260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.446537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.447286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.448934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.451437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cf5264b1da4554b2269d6ae291ebe5, user_id=a21a81cf49444a5ab66b6b83e518007a, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.454074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.458278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 805/1618] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.459152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.468849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 814/1619] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:14 2022] PUT /identity/v3/projects/65cf5264b1da4554b2269d6ae291ebe5/users/a21a81cf49444a5ab66b6b83e518007a/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:14.469927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36656a-9c9c-4d1d-a04d-4f2c463f1a41 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.470122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.530275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743664c-013d-4f94-bd04-a5f48330bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.531084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743664c-013d-4f94-bd04-a5f48330bba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.531416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743664c-013d-4f94-bd04-a5f48330bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.531715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743664c-013d-4f94-bd04-a5f48330bba8 admin admin] PATH_INFO: `/v3/projects/50c4f08e6606441bb08a6fd4f888c387/users/325ef40c4b324d7495f0407a57b9b3ab/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.533526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2849517-4189-4ec4-9e57-4b52620b96d2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.538196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.538866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.539164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.539474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.540221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.541823 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.545441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743664c-013d-4f94-bd04-a5f48330bba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c4f08e6606441bb08a6fd4f888c387, user_id=325ef40c4b324d7495f0407a57b9b3ab, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.548708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743664c-013d-4f94-bd04-a5f48330bba8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.552000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 815/1620] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:14.552778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.562341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef99a-224b-4ef4-ac7b-ed70e1e15af3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.565079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 806/1621] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:14 2022] PUT /identity/v3/projects/50c4f08e6606441bb08a6fd4f888c387/users/325ef40c4b324d7495f0407a57b9b3ab/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:14.566407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadf622-ca57-49f8-8410-6d1cf15e2c7f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.566759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadf622-ca57-49f8-8410-6d1cf15e2c7f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.567098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadf622-ca57-49f8-8410-6d1cf15e2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.584317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ebadf622-ca57-49f8-8410-6d1cf15e2c7f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:14.585526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ebadf622-ca57-49f8-8410-6d1cf15e2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:14.616387 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4847d-2e62-4dc5-9999-298ffc6de557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.617278 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4847d-2e62-4dc5-9999-298ffc6de557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.617562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4847d-2e62-4dc5-9999-298ffc6de557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.617842 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4847d-2e62-4dc5-9999-298ffc6de557 admin admin] PATH_INFO: `/v3/projects/efc9d81ec008435f932b56b0ddbf15d7/users/0f4054b1214f44d79df8176ca113e016/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.634749 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4847d-2e62-4dc5-9999-298ffc6de557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc9d81ec008435f932b56b0ddbf15d7, user_id=0f4054b1214f44d79df8176ca113e016, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.637495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4847d-2e62-4dc5-9999-298ffc6de557 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.642467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 807/1622] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:14.643303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadf622-ca57-49f8-8410-6d1cf15e2c7f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.652908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 816/1623] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:14 2022] PUT /identity/v3/projects/efc9d81ec008435f932b56b0ddbf15d7/users/0f4054b1214f44d79df8176ca113e016/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:14.653185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadf622-ca57-49f8-8410-6d1cf15e2c7f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.654207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08796296-edc9-48a7-ac1e-7b7ba992a9af None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.654614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08796296-edc9-48a7-ac1e-7b7ba992a9af None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.655142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08796296-edc9-48a7-ac1e-7b7ba992a9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.673225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-08796296-edc9-48a7-ac1e-7b7ba992a9af None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:14.674466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-08796296-edc9-48a7-ac1e-7b7ba992a9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:14.718513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.719604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.719885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.720161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] PATH_INFO: `/v3/projects/f432db4128fd41dcb4533e392be06161/users/93bd2a35edc74582b837a2e76b92bc93/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.736535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f432db4128fd41dcb4533e392be06161, user_id=93bd2a35edc74582b837a2e76b92bc93, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.738326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 817/1624] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:14.739147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08796296-edc9-48a7-ac1e-7b7ba992a9af None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.741217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.751277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08796296-edc9-48a7-ac1e-7b7ba992a9af None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.756270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 808/1625] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:14 2022] PUT /identity/v3/projects/f432db4128fd41dcb4533e392be06161/users/93bd2a35edc74582b837a2e76b92bc93/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:14.756996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.805318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af96a-1cf6-43d1-9858-f131ff3cae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.806126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af96a-1cf6-43d1-9858-f131ff3cae6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.806405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af96a-1cf6-43d1-9858-f131ff3cae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.806681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af96a-1cf6-43d1-9858-f131ff3cae6f admin admin] PATH_INFO: `/v3/projects/1b1982e2995242c4a9f4348bd098455d/users/877d3cf592584b4fb1ed4eaa43199060/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.815190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ff39c-393f-41fe-b26d-863756f750c7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.819917 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.820204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af96a-1cf6-43d1-9858-f131ff3cae6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1982e2995242c4a9f4348bd098455d, user_id=877d3cf592584b4fb1ed4eaa43199060, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.820829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.821115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.821398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] PATH_INFO: `/v3/projects/a9bb72f6394844cb8a1dc09ccf7091e7/users/c40552628e984be4af073e75d856d44e/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.822822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af96a-1cf6-43d1-9858-f131ff3cae6f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.836226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 818/1626] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:14 2022] PUT /identity/v3/projects/1b1982e2995242c4a9f4348bd098455d/users/877d3cf592584b4fb1ed4eaa43199060/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:14.836424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bb72f6394844cb8a1dc09ccf7091e7, user_id=c40552628e984be4af073e75d856d44e, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.837698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd19-80ba-4a26-8464-21b682fe4653 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.838089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd19-80ba-4a26-8464-21b682fe4653 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.838467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280dd19-80ba-4a26-8464-21b682fe4653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.838973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:14.852920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 809/1627] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:14 2022] PUT /identity/v3/projects/a9bb72f6394844cb8a1dc09ccf7091e7/users/c40552628e984be4af073e75d856d44e/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:14.853678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:14.865294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3280dd19-80ba-4a26-8464-21b682fe4653 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:14.866958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3280dd19-80ba-4a26-8464-21b682fe4653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:14.908509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362867a-1021-4087-90a1-e54a9eb7423e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:14.913288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:14.913968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.914347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.914848 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.926597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 819/1628] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:14.928309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8821-601c-431b-a0a5-66010c80075a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:14.928611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8821-601c-431b-a0a5-66010c80075a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:14.928886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8821-601c-431b-a0a5-66010c80075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:14.955321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-28be8821-601c-431b-a0a5-66010c80075a None None] MFA Rules not processed for user `0f4054b1214f44d79df8176ca113e016`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:14.956545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-28be8821-601c-431b-a0a5-66010c80075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:14.984104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:14.986270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.002469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 810/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:15.003276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.004817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:15.016372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2438-8f11-4b02-b601-77af9fc7b58c service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.020310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302178c-259b-4fa3-acde-14ded9f1a987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.021375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302178c-259b-4fa3-acde-14ded9f1a987 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.021375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302178c-259b-4fa3-acde-14ded9f1a987 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.021895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302178c-259b-4fa3-acde-14ded9f1a987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.027975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 820/1630] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:15.027975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9ae1-31bb-49a7-8286-b4ebecbe52a2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.027975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9ae1-31bb-49a7-8286-b4ebecbe52a2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.027975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9ae1-31bb-49a7-8286-b4ebecbe52a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.038247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302178c-259b-4fa3-acde-14ded9f1a987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.040013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302178c-259b-4fa3-acde-14ded9f1a987 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.048264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b3ee9ae1-31bb-49a7-8286-b4ebecbe52a2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:15.050095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b3ee9ae1-31bb-49a7-8286-b4ebecbe52a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:15.052083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 811/1631] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:15.053610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6291-4e2c-43f9-8060-fc9cbd51cfe3 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.054020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6291-4e2c-43f9-8060-fc9cbd51cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.054498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc6291-4e2c-43f9-8060-fc9cbd51cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.059292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 821/1632] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:15.060015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9ae1-31bb-49a7-8286-b4ebecbe52a2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.069982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9ae1-31bb-49a7-8286-b4ebecbe52a2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.078027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.078738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.079025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.079308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.080385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.081761 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.090505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-19fc6291-4e2c-43f9-8060-fc9cbd51cfe3 None None] MFA Rules not processed for user `877d3cf592584b4fb1ed4eaa43199060`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:15.092418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-19fc6291-4e2c-43f9-8060-fc9cbd51cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:15.093375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 822/1633] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:15.093646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.104081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750269a7-20a5-4a4e-b2f1-5acdc201e417 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.110429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.111359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.111683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.111966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.125243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.126895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.140154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 823/1634] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:15.142432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.155815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb60e4-7102-43c2-ac30-4fa607e8da3c service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.164934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.166730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.167022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.167297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.169574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.173448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.190775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 812/1635] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:15.190775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc6291-4e2c-43f9-8060-fc9cbd51cfe3 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.221682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 824/1636] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:15.221682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.224122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc6291-4e2c-43f9-8060-fc9cbd51cfe3 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.308645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf13b6-8c91-470b-a5e6-2738a5c487f8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.312689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437f744-35c3-4524-835f-91daa5a80e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.313433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f744-35c3-4524-835f-91daa5a80e44 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.313719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f744-35c3-4524-835f-91daa5a80e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.313999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437f744-35c3-4524-835f-91daa5a80e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.338758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819760a-7b3a-4497-9f7c-64bc1affc00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.340302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819760a-7b3a-4497-9f7c-64bc1affc00c admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.340595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819760a-7b3a-4497-9f7c-64bc1affc00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.341567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819760a-7b3a-4497-9f7c-64bc1affc00c admin admin] PATH_INFO: `/v3/projects/a9bb72f6394844cb8a1dc09ccf7091e7/users/c40552628e984be4af073e75d856d44e/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.351994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819760a-7b3a-4497-9f7c-64bc1affc00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bb72f6394844cb8a1dc09ccf7091e7, user_id=c40552628e984be4af073e75d856d44e, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.358256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819760a-7b3a-4497-9f7c-64bc1affc00c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.375623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 813/1637] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:15 2022] PUT /identity/v3/projects/a9bb72f6394844cb8a1dc09ccf7091e7/users/c40552628e984be4af073e75d856d44e/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:15.377481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85ec1-616b-4a18-9161-3152e083446a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.378032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85ec1-616b-4a18-9161-3152e083446a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.378624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85ec1-616b-4a18-9161-3152e083446a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.380875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 814/1638] 10.222.0.60 () {54 vars in 961 bytes} [Mon Feb 7 20:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:15.381839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85ec1-616b-4a18-9161-3152e083446a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.401512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437f744-35c3-4524-835f-91daa5a80e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.403320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437f744-35c3-4524-835f-91daa5a80e44 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.419858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 825/1639] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:15.422461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004590b-5eb7-42b5-a815-54df38e6e828 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.423012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004590b-5eb7-42b5-a815-54df38e6e828 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.423548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004590b-5eb7-42b5-a815-54df38e6e828 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.425788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 826/1640] 10.222.0.60 () {54 vars in 961 bytes} [Mon Feb 7 20:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:15.427150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0442-e7ee-4446-ba9e-8e7e158e0df7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.427708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0442-e7ee-4446-ba9e-8e7e158e0df7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.428741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0442-e7ee-4446-ba9e-8e7e158e0df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.466075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-132e0442-e7ee-4446-ba9e-8e7e158e0df7 None None] MFA Rules not processed for user `c40552628e984be4af073e75d856d44e`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:15.467346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-132e0442-e7ee-4446-ba9e-8e7e158e0df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:15.480973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85ec1-616b-4a18-9161-3152e083446a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.488353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac27bbf-16c1-4ced-a9b8-e205701ea6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.489408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac27bbf-16c1-4ced-a9b8-e205701ea6eb admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.489930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac27bbf-16c1-4ced-a9b8-e205701ea6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.490379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac27bbf-16c1-4ced-a9b8-e205701ea6eb admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.491438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac27bbf-16c1-4ced-a9b8-e205701ea6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.495425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac27bbf-16c1-4ced-a9b8-e205701ea6eb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.527694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 815/1641] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/users => generated 306 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:15.530609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a17de-70b5-40d8-9f09-21662c34eaf1 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.530962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a17de-70b5-40d8-9f09-21662c34eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.533043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a17de-70b5-40d8-9f09-21662c34eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.561005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-234a17de-70b5-40d8-9f09-21662c34eaf1 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:15.562349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-234a17de-70b5-40d8-9f09-21662c34eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:15.579547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 827/1642] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:15.581044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcfc2-6119-428a-9060-9881d2afbdd3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.581793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcfc2-6119-428a-9060-9881d2afbdd3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.582643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bcfc2-6119-428a-9060-9881d2afbdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.614732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4e0bcfc2-6119-428a-9060-9881d2afbdd3 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:15.616146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4e0bcfc2-6119-428a-9060-9881d2afbdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:15.657377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 816/1643] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:15.659008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a17de-70b5-40d8-9f09-21662c34eaf1 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.671093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a17de-70b5-40d8-9f09-21662c34eaf1 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.677548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.678324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.678808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.679028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.679904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.682258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.698673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 817/1644] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:15.700389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.720301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 828/1645] 10.222.0.60 () {58 vars in 1058 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:15.721097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bcfc2-6119-428a-9060-9881d2afbdd3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.736586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bcfc2-6119-428a-9060-9881d2afbdd3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.744246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572d270-abc5-4630-b159-c7880c94ce2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.745881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572d270-abc5-4630-b159-c7880c94ce2c service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.746479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572d270-abc5-4630-b159-c7880c94ce2c service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.747935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572d270-abc5-4630-b159-c7880c94ce2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.821500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ad62f-9bf7-41ae-809b-6478b90ef866 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.825992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.827756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.828042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.828492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.841554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.844410 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.855993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 818/1646] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:15.862464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572d270-abc5-4630-b159-c7880c94ce2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.865148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572d270-abc5-4630-b159-c7880c94ce2c service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.875658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.879769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 829/1647] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:15.893970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c586-c217-43b9-9778-aee1a10dae31 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.894308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c586-c217-43b9-9778-aee1a10dae31 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.895700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c586-c217-43b9-9778-aee1a10dae31 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.901299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 830/1648] 10.222.0.60 () {54 vars in 912 bytes} [Mon Feb 7 20:35:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:15.903762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb03b-0276-4cbb-9437-74405b715b36 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.904084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb03b-0276-4cbb-9437-74405b715b36 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.904373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb03b-0276-4cbb-9437-74405b715b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.904540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815d03-35e8-4aed-b77f-4837c6fc27d8 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.921529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.923672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.923973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.924256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] PATH_INFO: `/v3/projects/d2b14fe8f2864c34b564d8228a823460/users/17cc19406a47465db5dfc4e3b71ae650/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:15.926607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3b1bb03b-0276-4cbb-9437-74405b715b36 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:15.928092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3b1bb03b-0276-4cbb-9437-74405b715b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:15.939658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 831/1649] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:15.952295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb03b-0276-4cbb-9437-74405b715b36 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:15.973645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb03b-0276-4cbb-9437-74405b715b36 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:15.975922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b14fe8f2864c34b564d8228a823460, user_id=17cc19406a47465db5dfc4e3b71ae650, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:15.981436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:15.982754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:15.983632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:15.984393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:15.984686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.012904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 819/1650] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:15 2022] PUT /identity/v3/projects/d2b14fe8f2864c34b564d8228a823460/users/17cc19406a47465db5dfc4e3b71ae650/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:16.014918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:16.016667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:16.018182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:16.050489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 832/1651] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:16.101979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:16.112785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96f725-f696-4aa4-93cc-cb305b094482 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:16.154626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18274-573d-4335-815a-77cda6fac517 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:16.179224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:16.181078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.181374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.182072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.184613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:16.190137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:16.222727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 820/1652] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:16.226120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:16.261186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50d33-165b-4735-a774-52385960fa1f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:16.281358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98050f51-928a-469e-b5cb-ccd3e386359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:16.286187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050f51-928a-469e-b5cb-ccd3e386359f admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.286378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050f51-928a-469e-b5cb-ccd3e386359f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.292095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ec064-141b-40b2-a68c-5abf2b672d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:16.293083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec064-141b-40b2-a68c-5abf2b672d8a service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.293571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec064-141b-40b2-a68c-5abf2b672d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.295867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ec064-141b-40b2-a68c-5abf2b672d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.299818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050f51-928a-469e-b5cb-ccd3e386359f admin admin] PATH_INFO: `/v3/projects/d2b14fe8f2864c34b564d8228a823460/users/17cc19406a47465db5dfc4e3b71ae650/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.302084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98050f51-928a-469e-b5cb-ccd3e386359f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b14fe8f2864c34b564d8228a823460, user_id=17cc19406a47465db5dfc4e3b71ae650, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:16.305029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98050f51-928a-469e-b5cb-ccd3e386359f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:16.324716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 821/1653] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:16 2022] PUT /identity/v3/projects/d2b14fe8f2864c34b564d8228a823460/users/17cc19406a47465db5dfc4e3b71ae650/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:16.326537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656431d-9c16-42f1-b588-40d2b5ffbe29 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.326826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656431d-9c16-42f1-b588-40d2b5ffbe29 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.327105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656431d-9c16-42f1-b588-40d2b5ffbe29 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.333759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 822/1654] 10.222.0.60 () {54 vars in 912 bytes} [Mon Feb 7 20:35:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:16.335375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc86d-811b-482d-966e-b916496d5cea None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.335769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc86d-811b-482d-966e-b916496d5cea None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.336042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc86d-811b-482d-966e-b916496d5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.398423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c50dc86d-811b-482d-966e-b916496d5cea None None] MFA Rules not processed for user `17cc19406a47465db5dfc4e3b71ae650`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:16.399733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c50dc86d-811b-482d-966e-b916496d5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:16.418169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ec064-141b-40b2-a68c-5abf2b672d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:16.423098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ec064-141b-40b2-a68c-5abf2b672d8a service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:16.435690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 833/1655] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:16.438715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340382-589f-42eb-9045-2ccb62c0900c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.439533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340382-589f-42eb-9045-2ccb62c0900c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.440579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c340382-589f-42eb-9045-2ccb62c0900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.518495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1c340382-589f-42eb-9045-2ccb62c0900c None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:16.537958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1c340382-589f-42eb-9045-2ccb62c0900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:16.630510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 823/1656] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:16.703607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 834/1657] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:16.733744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc86d-811b-482d-966e-b916496d5cea None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:16.851793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dc86d-811b-482d-966e-b916496d5cea None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:16.858868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:16.859221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.860844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.861584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.885295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:16.886769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:16.916627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c340382-589f-42eb-9045-2ccb62c0900c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:16.925789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 824/1658] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:16.928925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c340382-589f-42eb-9045-2ccb62c0900c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:16.940074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb435e79-bc0f-4b5c-91f0-c76e0c0f13f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:16.940746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435e79-bc0f-4b5c-91f0-c76e0c0f13f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:16.941029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435e79-bc0f-4b5c-91f0-c76e0c0f13f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:16.941306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435e79-bc0f-4b5c-91f0-c76e0c0f13f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:16.963798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb435e79-bc0f-4b5c-91f0-c76e0c0f13f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:16.966115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb435e79-bc0f-4b5c-91f0-c76e0c0f13f7 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:16.987294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 835/1659] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:17.128825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:17.138024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5b42-1daf-46c0-9b3e-3fe8e24b7faf service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:17.147994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d2fdd-0330-48cc-879f-44a304c07d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:17.148663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d2fdd-0330-48cc-879f-44a304c07d6d service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:17.148950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d2fdd-0330-48cc-879f-44a304c07d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:17.149226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d2fdd-0330-48cc-879f-44a304c07d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:17.279426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d2fdd-0330-48cc-879f-44a304c07d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:17.279426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d2fdd-0330-48cc-879f-44a304c07d6d service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:17.299358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 825/1660] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:17.333437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8483-9072-4859-84d4-f753d5a29594 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:17.333906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8483-9072-4859-84d4-f753d5a29594 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:17.334292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8483-9072-4859-84d4-f753d5a29594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:17.411422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-41bf8483-9072-4859-84d4-f753d5a29594 None None] MFA Rules not processed for user `93bd2a35edc74582b837a2e76b92bc93`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:17.412640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-41bf8483-9072-4859-84d4-f753d5a29594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:17.554855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 836/1661] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:17.565641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e237cbc-80e9-49ec-a824-794171b9f4f2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:17.566688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e237cbc-80e9-49ec-a824-794171b9f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:17.567198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e237cbc-80e9-49ec-a824-794171b9f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:17.603171 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-8e237cbc-80e9-49ec-a824-794171b9f4f2 None None] MFA Rules not processed for user `93bd2a35edc74582b837a2e76b92bc93`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:17.610188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8e237cbc-80e9-49ec-a824-794171b9f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:17.630771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 826/1662] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:17.649994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf8483-9072-4859-84d4-f753d5a29594 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:17.679240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ca66-d21d-42a9-84b5-aa4d13d41b29 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:17.679567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ca66-d21d-42a9-84b5-aa4d13d41b29 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:17.679853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088ca66-d21d-42a9-84b5-aa4d13d41b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:17.689300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf8483-9072-4859-84d4-f753d5a29594 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:17.710983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e80d96-d7d1-47f9-8cda-084cea34651c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:17.711142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7088ca66-d21d-42a9-84b5-aa4d13d41b29 None None] MFA Rules not processed for user `325ef40c4b324d7495f0407a57b9b3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:17.711538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80d96-d7d1-47f9-8cda-084cea34651c service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:17.711826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80d96-d7d1-47f9-8cda-084cea34651c service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:17.712103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80d96-d7d1-47f9-8cda-084cea34651c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:17.712342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7088ca66-d21d-42a9-84b5-aa4d13d41b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:17.737972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e80d96-d7d1-47f9-8cda-084cea34651c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:17.739865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e80d96-d7d1-47f9-8cda-084cea34651c service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:17.784591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 837/1663] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:17.818020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 827/1664] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:17.818656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083f825-df6f-47f8-91d5-88f40fa0addf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:17.818994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083f825-df6f-47f8-91d5-88f40fa0addf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:17.819281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083f825-df6f-47f8-91d5-88f40fa0addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:17.860354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2083f825-df6f-47f8-91d5-88f40fa0addf None None] MFA Rules not processed for user `325ef40c4b324d7495f0407a57b9b3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:17.868078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2083f825-df6f-47f8-91d5-88f40fa0addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:17.884829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 838/1665] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:17.976005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ca66-d21d-42a9-84b5-aa4d13d41b29 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:17.998449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088ca66-d21d-42a9-84b5-aa4d13d41b29 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:18.019572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829179d-f95f-4df6-9a71-8d56d54a72c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:18.020929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829179d-f95f-4df6-9a71-8d56d54a72c6 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:18.021301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829179d-f95f-4df6-9a71-8d56d54a72c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:18.021864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829179d-f95f-4df6-9a71-8d56d54a72c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:18.043801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829179d-f95f-4df6-9a71-8d56d54a72c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:18.049209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829179d-f95f-4df6-9a71-8d56d54a72c6 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:18.073980 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 828/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:18.544329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1de118-dd82-46e4-82db-997773732693 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:18.545866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1de118-dd82-46e4-82db-997773732693 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:18.546502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1de118-dd82-46e4-82db-997773732693 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:18.549729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 839/1667] 10.222.0.60 () {54 vars in 912 bytes} [Mon Feb 7 20:35:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:18.555931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f3bb-0de7-44fb-b1a0-2a165702dca5 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:18.556213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f3bb-0de7-44fb-b1a0-2a165702dca5 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:18.557005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377f3bb-0de7-44fb-b1a0-2a165702dca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:18.602381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-b377f3bb-0de7-44fb-b1a0-2a165702dca5 None None] MFA Rules not processed for user `7b86cad4ee844bdeae28d8a07d8a49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:18.604692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b377f3bb-0de7-44fb-b1a0-2a165702dca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:18.702501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 829/1668] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:35:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:18.717747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1de118-dd82-46e4-82db-997773732693 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:18.730848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1de118-dd82-46e4-82db-997773732693 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:18.738782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d0e06-eef7-4bfb-a414-cc058b9b27c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:18.739784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d0e06-eef7-4bfb-a414-cc058b9b27c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:18.740294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d0e06-eef7-4bfb-a414-cc058b9b27c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:18.740851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d0e06-eef7-4bfb-a414-cc058b9b27c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:18.770367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d0e06-eef7-4bfb-a414-cc058b9b27c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:18.775217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d0e06-eef7-4bfb-a414-cc058b9b27c3 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:18.798995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 840/1669] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:18.962783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d489c2d-6873-487c-aaef-737f2e180ea4 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:18.963313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d489c2d-6873-487c-aaef-737f2e180ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:18.963918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d489c2d-6873-487c-aaef-737f2e180ea4 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:18.966127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 830/1670] 10.222.0.60 () {54 vars in 912 bytes} [Mon Feb 7 20:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:19.046824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607083c-8bbf-4613-accc-8d8868bfd790 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:19.046824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607083c-8bbf-4613-accc-8d8868bfd790 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:19.046824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607083c-8bbf-4613-accc-8d8868bfd790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:19.046824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6607083c-8bbf-4613-accc-8d8868bfd790 None None] MFA Rules not processed for user `7b86cad4ee844bdeae28d8a07d8a49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:19.046824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6607083c-8bbf-4613-accc-8d8868bfd790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:19.053794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 841/1671] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:35:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:19.063812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d489c2d-6873-487c-aaef-737f2e180ea4 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:19.111645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d489c2d-6873-487c-aaef-737f2e180ea4 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:19.126694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:19.130987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:19.131604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:19.132112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:19.145403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:19.146882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:19.166513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 831/1672] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:19.457957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607083c-8bbf-4613-accc-8d8868bfd790 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:19.596004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607083c-8bbf-4613-accc-8d8868bfd790 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:19.614977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42103910-5ad8-4711-852d-c239aa0b55a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c7f1498d7e4ef79977166d285e5e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:19.615841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42103910-5ad8-4711-852d-c239aa0b55a4 service placement] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:19.616222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42103910-5ad8-4711-852d-c239aa0b55a4 service placement] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:19.616828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42103910-5ad8-4711-852d-c239aa0b55a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:19.619237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-42103910-5ad8-4711-852d-c239aa0b55a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:19.641238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42103910-5ad8-4711-852d-c239aa0b55a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:19.643666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42103910-5ad8-4711-852d-c239aa0b55a4 service placement] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:19.663191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 842/1673] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:21.255108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:21.370369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b37d1-a588-4375-bb23-ef5fa4b3a122 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:21.379776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:21.382493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:21.383027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:21.383624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] PATH_INFO: `/v3/users/877d3cf592584b4fb1ed4eaa43199060` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:21.385354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877d3cf592584b4fb1ed4eaa43199060)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:21.387910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:21.487968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877d3cf592584b4fb1ed4eaa43199060'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:21.514465 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877d3cf592584b4fb1ed4eaa43199060'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:21.541354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877d3cf592584b4fb1ed4eaa43199060'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:21.570406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877d3cf592584b4fb1ed4eaa43199060'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:21.571120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877d3cf592584b4fb1ed4eaa43199060'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:21.587323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 832/1674] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:21 2022] DELETE /identity/v3/users/877d3cf592584b4fb1ed4eaa43199060 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:21.591856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:21.592446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:21.592446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:21.629861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:21.631093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:21.774602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 843/1675] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:21.789368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:21.791240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:21.943370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2520a-4674-48c3-bb75-9e5fb78dfb92 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:21.948172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fc6d8-5e0a-4af1-9f87-d4c1259e1182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:21.949129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fc6d8-5e0a-4af1-9f87-d4c1259e1182 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:21.949569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fc6d8-5e0a-4af1-9f87-d4c1259e1182 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:21.949997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fc6d8-5e0a-4af1-9f87-d4c1259e1182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:21.960979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fc6d8-5e0a-4af1-9f87-d4c1259e1182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:21.962733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fc6d8-5e0a-4af1-9f87-d4c1259e1182 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:21.974337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 833/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:22.611759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:22.616638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:22.658981 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2454-b439-4784-aa5d-19c65c37c196 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:22.670811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:22.671753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:22.672033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:22.672481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] PATH_INFO: `/v3/projects/1b1982e2995242c4a9f4348bd098455d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:22.673963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1982e2995242c4a9f4348bd098455d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:22.676408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:22.753728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1982e2995242c4a9f4348bd098455d', 'request_id': 'req-aaed161c-a313-45d0-830f-7f7e934e44f2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:22.768649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1982e2995242c4a9f4348bd098455d', 'request_id': 'req-aaed161c-a313-45d0-830f-7f7e934e44f2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:22.794186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1982e2995242c4a9f4348bd098455d', 'request_id': 'req-aaed161c-a313-45d0-830f-7f7e934e44f2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:22.817109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] The token cache is being invalidate because project 1b1982e2995242c4a9f4348bd098455d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:22.817770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:22.818677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-aaed161c-a313-45d0-830f-7f7e934e44f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:22.820943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 844/1677] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:22 2022] DELETE /identity/v3/projects/1b1982e2995242c4a9f4348bd098455d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:22.830214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2b18-ca22-4249-9dd5-54f53d9d9e74 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:22.830214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2b18-ca22-4249-9dd5-54f53d9d9e74 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:22.830214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2b18-ca22-4249-9dd5-54f53d9d9e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:22.881848 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6a2a2b18-ca22-4249-9dd5-54f53d9d9e74 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:22.883219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6a2a2b18-ca22-4249-9dd5-54f53d9d9e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:22.965863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 834/1678] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:22.975034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30da61-aaa5-417a-bf0a-5d9a56c18bcc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:22.975324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30da61-aaa5-417a-bf0a-5d9a56c18bcc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:22.975640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30da61-aaa5-417a-bf0a-5d9a56c18bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.009714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-dd30da61-aaa5-417a-bf0a-5d9a56c18bcc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:23.011480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dd30da61-aaa5-417a-bf0a-5d9a56c18bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:23.022803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 845/1679] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:23.027063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a2b18-ca22-4249-9dd5-54f53d9d9e74 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.043329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a2b18-ca22-4249-9dd5-54f53d9d9e74 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:23.053592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:23.054829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.055879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.056340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.058351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:23.059061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:23.061894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:23.083137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 835/1680] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:23.088641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30da61-aaa5-417a-bf0a-5d9a56c18bcc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.104738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30da61-aaa5-417a-bf0a-5d9a56c18bcc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:23.110927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:23.111693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.112033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.112321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.113046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:23.115139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:23.159593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 846/1681] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:23 2022] POST /identity/v3/projects => generated 393 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:23.162955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.181184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686039-c371-45e2-bb3e-e5907fd31d0b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:23.308649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:23.309446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.309831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.310233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.311494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:23.315786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:23.356423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 836/1682] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:23 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:23.360902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.384708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ce82-c1ec-41d5-8da3-fdefbe4a77f8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:23.403618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:23.406618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.407099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.407661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.409114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:23.412253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:23.429651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 847/1683] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:23.430676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.444310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398623d-fe3b-48f9-9d06-e5afa89de464 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:23.467518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c966f-c016-47f1-8f2c-6d38facdff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:23.468339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c966f-c016-47f1-8f2c-6d38facdff6f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.469355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c966f-c016-47f1-8f2c-6d38facdff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.469751 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c966f-c016-47f1-8f2c-6d38facdff6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.470882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c966f-c016-47f1-8f2c-6d38facdff6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:23.472449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c966f-c016-47f1-8f2c-6d38facdff6f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:23.500281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 837/1684] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:23.501399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.518289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3fc9-55a3-472c-949f-d9b866902b72 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:23.530822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:23.532367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.532716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.532913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] PATH_INFO: `/v3/projects/55f6c2bed2ed4ca98db80e3aae74bc30/users/ffd7f34f45c04abca73b72e1b79eeac1/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.575686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f6c2bed2ed4ca98db80e3aae74bc30, user_id=ffd7f34f45c04abca73b72e1b79eeac1, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:23.579193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:23.597122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 848/1685] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:23 2022] PUT /identity/v3/projects/55f6c2bed2ed4ca98db80e3aae74bc30/users/ffd7f34f45c04abca73b72e1b79eeac1/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:23.610456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa062-ae43-427b-b1fa-ce49180df26d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.610569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa062-ae43-427b-b1fa-ce49180df26d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.611000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa062-ae43-427b-b1fa-ce49180df26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.679715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-728fa062-ae43-427b-b1fa-ce49180df26d None None] MFA Rules not processed for user `ffd7f34f45c04abca73b72e1b79eeac1`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:23.679715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-728fa062-ae43-427b-b1fa-ce49180df26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:23.809790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.822275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 838/1686] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:23.912690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4268729-3e70-491e-b9d1-fe4c5b3f1ddc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:23.918545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:23.919295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:23.919636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:23.919916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:23.920634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:23.923224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:23.980172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa062-ae43-427b-b1fa-ce49180df26d None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:23.992110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 849/1687] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:23 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:24.002219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa062-ae43-427b-b1fa-ce49180df26d None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:24.107712 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:24.109395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:24.109832 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:24.110499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:24.111608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:24.114382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:24.162801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 839/1688] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:23 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:24.164179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:24.183046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40e7b-da3b-4ca7-828d-516640340131 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:24.200530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:24.203011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:24.204856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:24.205274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:24.210386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:24.212675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:24.251200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 850/1689] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:24.256919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:24.281640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa163c-fd54-4382-b967-c81d8acd7d1e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:24.290649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:24.291942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:24.292375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:24.292665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] PATH_INFO: `/v3/projects/ee3a2a1037494d8188391ef57b18b483/users/f8ab0ee96f7345178059c747df420188/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:24.315062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3a2a1037494d8188391ef57b18b483, user_id=f8ab0ee96f7345178059c747df420188, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:24.319259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:24.347432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 840/1690] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:24 2022] PUT /identity/v3/projects/ee3a2a1037494d8188391ef57b18b483/users/f8ab0ee96f7345178059c747df420188/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:24.351459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:24.366237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e55c5-062a-4363-b104-41b552126c55 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:24.438263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e90ea2-a331-4c89-8d42-6117b1b359fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:24.438964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90ea2-a331-4c89-8d42-6117b1b359fd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:24.439248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90ea2-a331-4c89-8d42-6117b1b359fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:24.439561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e90ea2-a331-4c89-8d42-6117b1b359fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:24.440320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e90ea2-a331-4c89-8d42-6117b1b359fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:24.446643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e90ea2-a331-4c89-8d42-6117b1b359fd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:24.466286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 851/1691] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:24.468157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:24.503215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6e0e-8447-47b0-94ec-b664e09d4413 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:24.528248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:24.529971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:24.531474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:24.531772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] PATH_INFO: `/v3/projects/ee3a2a1037494d8188391ef57b18b483/users/f8ab0ee96f7345178059c747df420188/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:24.537486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3a2a1037494d8188391ef57b18b483, user_id=f8ab0ee96f7345178059c747df420188, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:24.541841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:24.556329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 841/1692] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:24 2022] PUT /identity/v3/projects/ee3a2a1037494d8188391ef57b18b483/users/f8ab0ee96f7345178059c747df420188/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:24.569369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:24.569642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:24.569925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:24.632376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] MFA Rules not processed for user `f8ab0ee96f7345178059c747df420188`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:24.633612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:24.813220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 852/1693] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:24.929236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:24.931314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:25.103331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:25.107234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:25.166356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c070df-a954-491a-818b-425349f79ef3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:25.176450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:25.177362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:25.177789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:25.178217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:25.208136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:25.211071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:25.234202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 842/1694] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:25.359628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391633cb-8015-48f0-bc34-23cbd9e73338 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:25.384891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:25.386127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:25.388193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:25.389499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] PATH_INFO: `/v3/users/0f4054b1214f44d79df8176ca113e016` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:25.397030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4054b1214f44d79df8176ca113e016)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:25.408124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:35:25.408124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 07 20:35:25.408124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: Feb 07 20:35:25.411268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:25.492433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:25.511934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bee9b3-df0e-440b-8ad8-add1a836b1c1 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:25.533532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e11ac7-5a4d-4782-b16e-09186a487389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:25.534227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e11ac7-5a4d-4782-b16e-09186a487389 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:25.534537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e11ac7-5a4d-4782-b16e-09186a487389 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:25.534816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e11ac7-5a4d-4782-b16e-09186a487389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:25.574296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4054b1214f44d79df8176ca113e016'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:25.589603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4054b1214f44d79df8176ca113e016'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:25.608040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4054b1214f44d79df8176ca113e016'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:25.689108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4054b1214f44d79df8176ca113e016'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:25.700178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4715ec70-0680-442a-bafc-0d2004758f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4054b1214f44d79df8176ca113e016'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:25.716139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 853/1695] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:25 2022] DELETE /identity/v3/users/0f4054b1214f44d79df8176ca113e016 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:25.716325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e11ac7-5a4d-4782-b16e-09186a487389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:25.717741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:25.718106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:25.718523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e11ac7-5a4d-4782-b16e-09186a487389 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:25.718668 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:25.738602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 843/1696] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:25.743482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e9108-87a7-42bb-ace8-3b17533da9b0 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:25.744065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e9108-87a7-42bb-ace8-3b17533da9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:25.744498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e9108-87a7-42bb-ace8-3b17533da9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:25.757425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:25.772818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:25.798051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a95e9108-87a7-42bb-ace8-3b17533da9b0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:25.803806 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a95e9108-87a7-42bb-ace8-3b17533da9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:25.907405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 854/1697] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:35:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:25.986887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 844/1698] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:26.035093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:26.036574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:26.094392 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:26.095730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:26.096228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:26.179771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] MFA Rules not processed for user `97f892d00220472eaca2e132ddba2db8`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:26.184944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:26.213254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca82668-402d-49fc-a8f9-472a30e8f3c4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:26.227262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:26.228081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:26.229358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:26.229893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:26.270819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:26.272549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:26.323193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 855/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:26.324243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:26.332025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:26.398409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 845/1700] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:26.410127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:26.412989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:26.456399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f01e1-af8d-4e1c-a6cd-ce2d7f1eeff3 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:26.473910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:26.476877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:26.477336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:26.477650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] PATH_INFO: `/v3/users/1a13b0b8fb82455daa18e673646d8556` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:26.480729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a13b0b8fb82455daa18e673646d8556)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:26.489817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:26.594271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a13b0b8fb82455daa18e673646d8556'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:26.598618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aa350-7dbc-4716-bdac-36683f7546f0 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:26.606181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a13b0b8fb82455daa18e673646d8556'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:26.613645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e2d4-1bdd-4ed5-850f-5d6ed24f17e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:26.614116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e2d4-1bdd-4ed5-850f-5d6ed24f17e3 service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:26.614422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e2d4-1bdd-4ed5-850f-5d6ed24f17e3 service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:26.614689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e2d4-1bdd-4ed5-850f-5d6ed24f17e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:26.631244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a13b0b8fb82455daa18e673646d8556'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:26.633332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56e2d4-1bdd-4ed5-850f-5d6ed24f17e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:26.635115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56e2d4-1bdd-4ed5-850f-5d6ed24f17e3 service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:26.647863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a13b0b8fb82455daa18e673646d8556'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:26.648525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a13b0b8fb82455daa18e673646d8556'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:26.656357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 846/1701] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:26 2022] DELETE /identity/v3/users/1a13b0b8fb82455daa18e673646d8556 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:26.657710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:26.661692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:26.674893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 856/1702] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:35:26.678469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:26.678926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:26.680403 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:26.747970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:26.749417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:26.876804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3e6e-095f-4b2b-882b-c5c01d321f21 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:26.897608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f65f87-9136-4b29-9273-c50ccc1a9450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:26.910658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65f87-9136-4b29-9273-c50ccc1a9450 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:26.911753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65f87-9136-4b29-9273-c50ccc1a9450 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:26.912830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65f87-9136-4b29-9273-c50ccc1a9450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:26.921906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-96f65f87-9136-4b29-9273-c50ccc1a9450 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:27.047943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 857/1703] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:27.082502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f65f87-9136-4b29-9273-c50ccc1a9450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:27.085268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f65f87-9136-4b29-9273-c50ccc1a9450 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:27.120461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:27.122259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:27.143110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 847/1704] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:27.364656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42070e75-b049-4729-b666-9e99460eaa57 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:27.377342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:27.378517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:27.379020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:27.380485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:27.413192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:27.419875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:27.459441 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 858/1705] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:28.425930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc2cd-0441-43b4-8fe9-142631b61919 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:28.426444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc2cd-0441-43b4-8fe9-142631b61919 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:28.427174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fc2cd-0441-43b4-8fe9-142631b61919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:28.436085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:28.438282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:28.474618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeeacd-f14b-4b1b-9f0e-737430ceef89 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:28.495197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:28.504773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:28.505659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:28.505982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] PATH_INFO: `/v3/projects/efc9d81ec008435f932b56b0ddbf15d7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:28.515161 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc9d81ec008435f932b56b0ddbf15d7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:28.525865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ab0fc2cd-0441-43b4-8fe9-142631b61919 None None] MFA Rules not processed for user `a21a81cf49444a5ab66b6b83e518007a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:28.532102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:28.537255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ab0fc2cd-0441-43b4-8fe9-142631b61919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:28.701491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc9d81ec008435f932b56b0ddbf15d7', 'request_id': 'req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:28.720799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc9d81ec008435f932b56b0ddbf15d7', 'request_id': 'req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:28.736139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc9d81ec008435f932b56b0ddbf15d7', 'request_id': 'req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:28.783189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] The token cache is being invalidate because project efc9d81ec008435f932b56b0ddbf15d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:28.786288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 848/1706] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:28.796039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:28.796365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:28.796659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:28.797380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:28.801865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:28.813498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 859/1707] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:28 2022] DELETE /identity/v3/projects/efc9d81ec008435f932b56b0ddbf15d7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:28.814798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:28.818153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:28.847518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] MFA Rules not processed for user `a21a81cf49444a5ab66b6b83e518007a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:28.850561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:29.049253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e635bbd-2ce5-4271-b9b4-89aa474ed9cc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:29.067765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:29.068952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:29.069386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:29.069813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] PATH_INFO: `/v3/users/17cc19406a47465db5dfc4e3b71ae650` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:29.076477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cc19406a47465db5dfc4e3b71ae650)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:29.079222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 849/1708] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:29.080914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:29.191881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:29.193753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:29.204141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cc19406a47465db5dfc4e3b71ae650'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:29.215347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cc19406a47465db5dfc4e3b71ae650'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:29.240702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cc19406a47465db5dfc4e3b71ae650'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:29.269592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cc19406a47465db5dfc4e3b71ae650'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:29.272098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cc19406a47465db5dfc4e3b71ae650'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:29.291320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 860/1709] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:28 2022] DELETE /identity/v3/users/17cc19406a47465db5dfc4e3b71ae650 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:29.481900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01764d8a-b724-4ce6-9854-1f2f4d8fa02b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:29.764061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf73564-53ae-4fed-9569-c43eb852ff66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:29.764746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73564-53ae-4fed-9569-c43eb852ff66 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:29.765071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73564-53ae-4fed-9569-c43eb852ff66 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:29.765365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf73564-53ae-4fed-9569-c43eb852ff66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:29.775231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5bf73564-53ae-4fed-9569-c43eb852ff66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:29.914670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73564-53ae-4fed-9569-c43eb852ff66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:29.916944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf73564-53ae-4fed-9569-c43eb852ff66 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:29.946154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 850/1710] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:30.516069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:30.518280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:30.652609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1742ce-deb8-4571-8fb6-996f42bd5a3b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:30.660725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:30.661898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:30.662853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:30.663627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] PATH_INFO: `/v3/projects/d2b14fe8f2864c34b564d8228a823460` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:30.665193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b14fe8f2864c34b564d8228a823460)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:30.667987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:30.824255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b14fe8f2864c34b564d8228a823460', 'request_id': 'req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:30.846353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b14fe8f2864c34b564d8228a823460', 'request_id': 'req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:30.851178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447e1a7-7bc3-4985-88a0-ff65c6e52505 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:30.852250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447e1a7-7bc3-4985-88a0-ff65c6e52505 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:30.852885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447e1a7-7bc3-4985-88a0-ff65c6e52505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:30.860936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b14fe8f2864c34b564d8228a823460', 'request_id': 'req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:30.903207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] The token cache is being invalidate because project d2b14fe8f2864c34b564d8228a823460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:30.907564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:30.909124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77e7b4d7-ee96-4e85-bc1c-a287dbd2977c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:30.919041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 861/1711] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:30 2022] DELETE /identity/v3/projects/d2b14fe8f2864c34b564d8228a823460 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:30.926150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:30.926741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:30.927249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:30.929973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-3447e1a7-7bc3-4985-88a0-ff65c6e52505 None None] MFA Rules not processed for user `7b86cad4ee844bdeae28d8a07d8a49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:30.932561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3447e1a7-7bc3-4985-88a0-ff65c6e52505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:30.979230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:30.984008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:31.166830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 851/1712] 10.222.0.24 () {58 vars in 1015 bytes} [Mon Feb 7 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:31.220542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 862/1713] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:31.239634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:31.240967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:31.241830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:31.260915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:31.264529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:31.304568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb416880-d33d-40e7-a1ce-51c0d597e913 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:31.324683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:31.326622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:31.328478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:31.328802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:31.329214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] PATH_INFO: `/v3/users/ffd7f34f45c04abca73b72e1b79eeac1` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:31.333830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:31.341189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd7f34f45c04abca73b72e1b79eeac1)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:31.354808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 852/1714] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:31.355986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:31.357276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:31.358659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:31.386404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11015a-80f3-4ed9-a912-5702900a46ef None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:31.398572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:31.399640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:31.400131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:31.400589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:31.424260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:31.432560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:31.457400 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 853/1715] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:31.464019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:31.494306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d70d0-7dd0-4c39-b804-7fbd597ab187 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:31.514135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:31.514810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:31.515684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:31.515974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:31.520474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd7f34f45c04abca73b72e1b79eeac1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:31.545662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd7f34f45c04abca73b72e1b79eeac1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:31.559687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:31.561060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:31.602550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd7f34f45c04abca73b72e1b79eeac1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:31.611707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 854/1716] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:31.612790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:31.628799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd7f34f45c04abca73b72e1b79eeac1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:31.630016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b731d123-6cb3-4aa8-b2ae-2a5491a60cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd7f34f45c04abca73b72e1b79eeac1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:31.644777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 863/1717] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:31 2022] DELETE /identity/v3/users/ffd7f34f45c04abca73b72e1b79eeac1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:31.650450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:31.650450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:31.650450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:31.663904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597580-8233-489a-ad14-b48657da9449 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:31.726372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:31.729552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:31.883906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:31.884598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:31.884889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:31.885148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:31.885938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:31.886234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:31.899486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:31.938200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 855/1718] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:31.938200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:31.940607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:31.971902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2ecf0-bae3-4ac0-9b66-9c3351f0eee1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:31.980629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:31.981747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:31.982197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:31.982792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] PATH_INFO: `/v3/projects/b690e585dc49422d8cce052c120e70c7` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:31.990816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b690e585dc49422d8cce052c120e70c7)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:31.992089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: WARNING py.warnings [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 20:35:31.992089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: warnings.warn(msg) Feb 07 20:35:31.992089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: Feb 07 20:35:31.993609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:32.071856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 864/1719] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:32.072026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:32.076550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:32.119170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171fb9-4b82-4df3-a495-7a1b7529db35 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:32.132938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b690e585dc49422d8cce052c120e70c7', 'request_id': 'req-cf31ca87-98ef-4636-9d9d-71ade1061510'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:32.183648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b690e585dc49422d8cce052c120e70c7', 'request_id': 'req-cf31ca87-98ef-4636-9d9d-71ade1061510'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:32.206151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b690e585dc49422d8cce052c120e70c7', 'request_id': 'req-cf31ca87-98ef-4636-9d9d-71ade1061510'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:32.234740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] The token cache is being invalidate because project b690e585dc49422d8cce052c120e70c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:32.235041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:32.240091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:32.245921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 856/1720] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:31 2022] DELETE /identity/v3/projects/b690e585dc49422d8cce052c120e70c7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:32.247078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:32.262170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:32.345854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f53db-7e9d-4431-ac73-665bb94b5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:32.346271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f53db-7e9d-4431-ac73-665bb94b5048 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.346561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f53db-7e9d-4431-ac73-665bb94b5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.346831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f53db-7e9d-4431-ac73-665bb94b5048 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.347588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f53db-7e9d-4431-ac73-665bb94b5048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:32.352084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f53db-7e9d-4431-ac73-665bb94b5048 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:32.460013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 865/1721] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:32 2022] POST /identity/v3/projects => generated 387 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:32.468994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9592f93-4c69-4593-a89c-a6acfc8bd309 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.471357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9592f93-4c69-4593-a89c-a6acfc8bd309 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.471702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9592f93-4c69-4593-a89c-a6acfc8bd309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.494351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31ca87-98ef-4636-9d9d-71ade1061510 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:32.572719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e9592f93-4c69-4593-a89c-a6acfc8bd309 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:32.578621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e9592f93-4c69-4593-a89c-a6acfc8bd309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:32.591508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:32.592232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.592564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.592929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.595511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:32.697570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:32.699608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:32.714019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 857/1722] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:32.715332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:32.717586 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:32.739898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa282d-6b84-46d1-a7b4-74b4eb81a324 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:32.746867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:32.747879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.748372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.748867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.750296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:32.752692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:32.782224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 866/1723] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:32.784474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b554a3-ad08-438d-938f-5a4c0aa71fb0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.784896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b554a3-ad08-438d-938f-5a4c0aa71fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.785430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b554a3-ad08-438d-938f-5a4c0aa71fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.828847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-35b554a3-ad08-438d-938f-5a4c0aa71fb0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:32.832211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-35b554a3-ad08-438d-938f-5a4c0aa71fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:32.847176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 858/1724] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:32 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:32.855643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:32.866840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 867/1725] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:32.868458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b554a3-ad08-438d-938f-5a4c0aa71fb0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:32.882731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed7da-d4a4-40c5-b590-1512c52d9533 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:32.893696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:32.894564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.894961 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.895424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.896535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:32.898594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:32.913338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 859/1726] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:32.913869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b554a3-ad08-438d-938f-5a4c0aa71fb0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:32.918227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:32.930062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:32.930759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.931043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.931360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.932124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:32.934384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:32.943658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:32.951872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e64023-f6c9-498e-86e8-50aca2786301 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:32.958942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:32.959656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:32.959939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:32.960219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:32.961411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:32.964402 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:32.987627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 868/1727] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:32.992261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.016452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f21f-0ff1-4ed3-bfe7-fe9937610972 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:33.036624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31931603-6a45-48d7-9e62-c71921487007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:33.039810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31931603-6a45-48d7-9e62-c71921487007 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.040105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31931603-6a45-48d7-9e62-c71921487007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.040389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31931603-6a45-48d7-9e62-c71921487007 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.040492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 860/1728] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:33.041115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31931603-6a45-48d7-9e62-c71921487007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:33.041392 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.043040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31931603-6a45-48d7-9e62-c71921487007 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:33.077137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ef900-6e1c-4c98-bbb1-aaee449b909f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:33.098443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:33.101810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 869/1729] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:32 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:33.101810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c6426-11a9-4e7f-8109-1b848f977b95 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.101810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c6426-11a9-4e7f-8109-1b848f977b95 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.101810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c6426-11a9-4e7f-8109-1b848f977b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.102200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.102200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.102200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] PATH_INFO: `/v3/projects/bbab853ced684bb091a2ca1ba762a39a/users/4547e40b23d44463a9386301baf5fa64/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.130869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8b4c6426-11a9-4e7f-8109-1b848f977b95 None None] MFA Rules not processed for user `a21a81cf49444a5ab66b6b83e518007a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:33.132585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8b4c6426-11a9-4e7f-8109-1b848f977b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:33.141919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbab853ced684bb091a2ca1ba762a39a, user_id=4547e40b23d44463a9386301baf5fa64, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:33.172067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:33.218954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 861/1730] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:33 2022] PUT /identity/v3/projects/bbab853ced684bb091a2ca1ba762a39a/users/4547e40b23d44463a9386301baf5fa64/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:33.227675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.268916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 870/1731] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:33.269152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a66f-2a49-4edb-8299-110d0b1e5507 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.269512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a66f-2a49-4edb-8299-110d0b1e5507 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.284628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a66f-2a49-4edb-8299-110d0b1e5507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.376423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c451a66f-2a49-4edb-8299-110d0b1e5507 None None] MFA Rules not processed for user `4547e40b23d44463a9386301baf5fa64`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:33.377934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c451a66f-2a49-4edb-8299-110d0b1e5507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:33.445814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ac306-8d01-41c7-9354-99f3f847d308 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:33.498536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:33.500855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.501408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.504503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.506558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:33.513200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:33.598745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 862/1732] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:33 2022] POST /identity/v3/users => generated 288 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:33.605360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.624998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd9b2-ec08-4759-ba00-376befd2bbbc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:33.634162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:33.635488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.635973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.636792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.638069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:33.641358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:33.647777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 871/1733] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:33.649772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451a66f-2a49-4edb-8299-110d0b1e5507 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.661255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 863/1734] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:33.665877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.670710 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451a66f-2a49-4edb-8299-110d0b1e5507 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:33.679984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084eab-337c-4837-b189-61ef5aea2e2f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:33.689587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:33.691632 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.692250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.692780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.693787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:33.696092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:33.701276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:33.711609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.711926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.712250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.713126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:33.714117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 864/1735] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:33.715949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:33.719228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.735981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c3a42-3488-48fe-9977-d86ca9599d3f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:33.744278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859b1e9-e46a-4d72-a868-75009d2c54dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:33.745825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b1e9-e46a-4d72-a868-75009d2c54dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.746336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b1e9-e46a-4d72-a868-75009d2c54dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.746826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b1e9-e46a-4d72-a868-75009d2c54dd admin admin] PATH_INFO: `/v3/projects/22a439ab25764f2fba6f3be01bbdcaa9/users/d168a305777e42b481512de3501d0145/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.770651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859b1e9-e46a-4d72-a868-75009d2c54dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a439ab25764f2fba6f3be01bbdcaa9, user_id=d168a305777e42b481512de3501d0145, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:33.775076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859b1e9-e46a-4d72-a868-75009d2c54dd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:33.801620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 865/1736] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:33 2022] PUT /identity/v3/projects/22a439ab25764f2fba6f3be01bbdcaa9/users/d168a305777e42b481512de3501d0145/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:33.816261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 872/1737] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:33 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:33.816457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09254e-924b-4b9c-aecb-e105d953cca7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:33.816457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09254e-924b-4b9c-aecb-e105d953cca7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:33.816457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09254e-924b-4b9c-aecb-e105d953cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:33.817583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:33.888339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ad09254e-924b-4b9c-aecb-e105d953cca7 None None] MFA Rules not processed for user `d168a305777e42b481512de3501d0145`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:33.892875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ad09254e-924b-4b9c-aecb-e105d953cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:34.049208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f8af-9971-47c4-bf12-2c5cb4e3db1f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:34.071510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 866/1738] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:34.084390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:34.085395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:34.085687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:34.085964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:34.086952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:34.088966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:34.170467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 873/1739] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:33 2022] POST /identity/v3/users => generated 301 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:34.180036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09254e-924b-4b9c-aecb-e105d953cca7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:34.223347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09254e-924b-4b9c-aecb-e105d953cca7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:34.252953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:34.254494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:34.255659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:34.257300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:34.259730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:34.266032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:34.294028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 867/1740] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:34.302895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:34.343659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e6e9-6d26-4022-a8b2-1b5059c88295 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:34.348980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:34.349866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:34.350155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:34.350431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] PATH_INFO: `/v3/projects/ee4595b3990d46b2b504a97f8355d94e/users/248f5ee8cafe40adb5801a8facc6aa6e/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:34.378816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4595b3990d46b2b504a97f8355d94e, user_id=248f5ee8cafe40adb5801a8facc6aa6e, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:34.381696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:34.400198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 874/1741] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:34 2022] PUT /identity/v3/projects/ee4595b3990d46b2b504a97f8355d94e/users/248f5ee8cafe40adb5801a8facc6aa6e/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:34.404278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:34.434922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d04b-f493-41d8-88ba-28367c838c98 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:34.546098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499f22-aba9-4181-8f38-a2e3f2cdbcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:34.549069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499f22-aba9-4181-8f38-a2e3f2cdbcac admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:34.549581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499f22-aba9-4181-8f38-a2e3f2cdbcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:34.550218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499f22-aba9-4181-8f38-a2e3f2cdbcac admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:34.551252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18499f22-aba9-4181-8f38-a2e3f2cdbcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:34.554297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18499f22-aba9-4181-8f38-a2e3f2cdbcac admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:34.571061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 868/1742] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:34.572889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:34.590067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4ace9-d88c-41da-98a2-fada8f3c86a8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:34.596478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:34.597381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:34.597663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:34.598159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] PATH_INFO: `/v3/projects/ee4595b3990d46b2b504a97f8355d94e/users/248f5ee8cafe40adb5801a8facc6aa6e/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:34.602417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4595b3990d46b2b504a97f8355d94e, user_id=248f5ee8cafe40adb5801a8facc6aa6e, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:34.608276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:34.637678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 875/1743] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:34 2022] PUT /identity/v3/projects/ee4595b3990d46b2b504a97f8355d94e/users/248f5ee8cafe40adb5801a8facc6aa6e/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:34.646354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb58f-6743-4707-a8e6-fb160055dbb5 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:34.648437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb58f-6743-4707-a8e6-fb160055dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:34.648695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afb58f-6743-4707-a8e6-fb160055dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:34.747991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c0afb58f-6743-4707-a8e6-fb160055dbb5 None None] MFA Rules not processed for user `248f5ee8cafe40adb5801a8facc6aa6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:34.752541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c0afb58f-6743-4707-a8e6-fb160055dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:34.970782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 869/1744] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:34.984548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:34.986649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:35.180744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11bbaf-8cd7-4ec9-9cf5-cdb6b1999b5b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:35.186620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:35.188031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:35.188315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:35.188595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:35.201252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:35.204566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:35.219666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 876/1745] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:35.463349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb58f-6743-4707-a8e6-fb160055dbb5 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:35.679655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afb58f-6743-4707-a8e6-fb160055dbb5 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:35.698546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:35.699530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:35.699819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:35.700209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] PATH_INFO: `/v3/users/4547e40b23d44463a9386301baf5fa64` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:35.702748 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4547e40b23d44463a9386301baf5fa64)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:35.708321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:35.805147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:35.807283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:35.849490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4547e40b23d44463a9386301baf5fa64'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:35.861564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4547e40b23d44463a9386301baf5fa64'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:35.928885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4547e40b23d44463a9386301baf5fa64'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:35.951563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4547e40b23d44463a9386301baf5fa64'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:35.953145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f2dc6e42-e7ea-4fb2-be2b-102ebde34d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4547e40b23d44463a9386301baf5fa64'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:35.974800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 870/1746] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:35 2022] DELETE /identity/v3/users/4547e40b23d44463a9386301baf5fa64 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:35.977031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a276-3af6-429a-8f60-43ab39a69f3b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:35.977430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a276-3af6-429a-8f60-43ab39a69f3b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:35.978530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a276-3af6-429a-8f60-43ab39a69f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:36.040058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a2b3a276-3af6-429a-8f60-43ab39a69f3b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:36.041291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a2b3a276-3af6-429a-8f60-43ab39a69f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:36.124617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b53a-db29-4d7b-b79d-cfa77eb50f10 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:36.266800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 871/1747] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:36.268454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1d2d-9b5f-4a33-b0eb-9fdf19904819 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:36.268744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1d2d-9b5f-4a33-b0eb-9fdf19904819 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:36.276148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1d2d-9b5f-4a33-b0eb-9fdf19904819 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:36.284977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 872/1748] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:35:36 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:36.288493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6427911-d495-4f67-80b2-6a72f0199f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:36.289859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427911-d495-4f67-80b2-6a72f0199f56 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:36.290517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427911-d495-4f67-80b2-6a72f0199f56 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:36.290997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6427911-d495-4f67-80b2-6a72f0199f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:36.293496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d6427911-d495-4f67-80b2-6a72f0199f56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:36.379327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1d2d-9b5f-4a33-b0eb-9fdf19904819 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:36.381225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-911b1d2d-9b5f-4a33-b0eb-9fdf19904819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:36.409031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6427911-d495-4f67-80b2-6a72f0199f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:36.428586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6427911-d495-4f67-80b2-6a72f0199f56 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:36.460093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 877/1749] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:36.466044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:36.466701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:36.469339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:36.527844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:36.529395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:36.588414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 878/1750] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:36.601340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1d2d-9b5f-4a33-b0eb-9fdf19904819 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:36.613490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdcdc4-6724-4a3c-ace3-ef23eec206b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:36.614430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcdc4-6724-4a3c-ace3-ef23eec206b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:36.614663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcdc4-6724-4a3c-ace3-ef23eec206b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:36.615037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcdc4-6724-4a3c-ace3-ef23eec206b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:36.636447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcdc4-6724-4a3c-ace3-ef23eec206b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:36.638339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcdc4-6724-4a3c-ace3-ef23eec206b7 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:36.660269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 873/1751] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:37.054755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:37.056553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:37.090142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0f5a1-4d60-4c30-880d-1fa44b19dabc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:37.131374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:37.135049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:37.135338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:37.139580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:37.164478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:37.164977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:37.165270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:37.210145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] MFA Rules not processed for user `97f892d00220472eaca2e132ddba2db8`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:37.212260 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:37.214659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:37.216466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:37.231520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 879/1752] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:37.463714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 874/1753] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:37.621144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:37.622320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:37.656145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42462ac-5b5d-4d86-bb13-5ed6dd4feaea service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:37.676015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:37.676899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:37.677158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:37.677487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] PATH_INFO: `/v3/projects/55f6c2bed2ed4ca98db80e3aae74bc30` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:37.679638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f6c2bed2ed4ca98db80e3aae74bc30)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:37.681547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:37.745527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:37.746969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:37.782747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f02844-e6cf-485b-b385-f8f664127bf9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:37.795699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:37.797271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:37.797555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:37.797831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] PATH_INFO: `/v3/projects/bbab853ced684bb091a2ca1ba762a39a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:37.800344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbab853ced684bb091a2ca1ba762a39a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:37.813913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:37.824229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f6c2bed2ed4ca98db80e3aae74bc30', 'request_id': 'req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:37.842342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f6c2bed2ed4ca98db80e3aae74bc30', 'request_id': 'req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:37.862683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f6c2bed2ed4ca98db80e3aae74bc30', 'request_id': 'req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:37.894423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] The token cache is being invalidate because project 55f6c2bed2ed4ca98db80e3aae74bc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:37.894688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:37.899695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:37.909000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 880/1754] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:37 2022] DELETE /identity/v3/projects/55f6c2bed2ed4ca98db80e3aae74bc30 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:37.912935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:37.914367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:37.950686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbab853ced684bb091a2ca1ba762a39a', 'request_id': 'req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:37.980552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbab853ced684bb091a2ca1ba762a39a', 'request_id': 'req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:37.997153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbab853ced684bb091a2ca1ba762a39a', 'request_id': 'req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.018871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] The token cache is being invalidate because project bbab853ced684bb091a2ca1ba762a39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:38.020071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.020796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.024811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 875/1755] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:37 2022] DELETE /identity/v3/projects/bbab853ced684bb091a2ca1ba762a39a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:38.027520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:38.032547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:38.077327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa177b-65eb-46ec-a0e0-09c4158b5b3b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:38.221448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:38.222496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:38.222990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:38.223530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] PATH_INFO: `/v3/users/d168a305777e42b481512de3501d0145` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:38.226187 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d168a305777e42b481512de3501d0145)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:38.228437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:38.269767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d937-34d1-4f77-8e9e-e9a24e7768c5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:38.285924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:38.289313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:38.289747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:38.290151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] PATH_INFO: `/v3/users/f8ab0ee96f7345178059c747df420188` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:38.298539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ab0ee96f7345178059c747df420188)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:38.303911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:38.322538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd168a305777e42b481512de3501d0145'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.364717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd168a305777e42b481512de3501d0145'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.389111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd168a305777e42b481512de3501d0145'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.427583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd168a305777e42b481512de3501d0145'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.428901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd168a305777e42b481512de3501d0145'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.442197 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 881/1756] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:37 2022] DELETE /identity/v3/users/d168a305777e42b481512de3501d0145 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:38.451324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:38.455109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ab0ee96f7345178059c747df420188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.456446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:38.475016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ab0ee96f7345178059c747df420188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.509933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ab0ee96f7345178059c747df420188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.545021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ab0ee96f7345178059c747df420188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.546536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-684add92-1fc7-4103-b7af-d81c5aed63d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ab0ee96f7345178059c747df420188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.562967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 876/1757] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:38 2022] DELETE /identity/v3/users/f8ab0ee96f7345178059c747df420188 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:38.565297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:38.565594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:38.565921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:38.620537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:38.626619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:38.642321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2d9a-ff32-4745-9154-8400c5bc4988 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:38.747851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 877/1758] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:38.773560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:38.776038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:38.778007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:38.779490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:38.784643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:38.784643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] PATH_INFO: `/v3/users/248f5ee8cafe40adb5801a8facc6aa6e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:38.788854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248f5ee8cafe40adb5801a8facc6aa6e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:38.795409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:38.915715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248f5ee8cafe40adb5801a8facc6aa6e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.931522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248f5ee8cafe40adb5801a8facc6aa6e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.938552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e895-892e-4cf7-b4bc-50889c04b4b9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:38.947965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e020c-1820-44da-865e-9413dd1c11ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:38.949888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248f5ee8cafe40adb5801a8facc6aa6e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.950729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e020c-1820-44da-865e-9413dd1c11ee service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:38.951072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e020c-1820-44da-865e-9413dd1c11ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:38.951427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e020c-1820-44da-865e-9413dd1c11ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:38.978920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e020c-1820-44da-865e-9413dd1c11ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:38.983537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248f5ee8cafe40adb5801a8facc6aa6e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:38.984188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e020c-1820-44da-865e-9413dd1c11ee service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:38.987267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248f5ee8cafe40adb5801a8facc6aa6e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:39.002254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 882/1759] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:38 2022] DELETE /identity/v3/users/248f5ee8cafe40adb5801a8facc6aa6e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:39.008721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 878/1760] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:39.454400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:39.456553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:39.579254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5161b2-92bf-491e-94b0-3c72f49cc2c7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:39.603587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:39.605422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:39.606049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:39.606541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] PATH_INFO: `/v3/projects/ee3a2a1037494d8188391ef57b18b483` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:39.608455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3a2a1037494d8188391ef57b18b483)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:39.611527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:39.734603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3a2a1037494d8188391ef57b18b483', 'request_id': 'req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:39.745176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3a2a1037494d8188391ef57b18b483', 'request_id': 'req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:39.763083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3a2a1037494d8188391ef57b18b483', 'request_id': 'req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:39.780798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] The token cache is being invalidate because project ee3a2a1037494d8188391ef57b18b483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:39.781151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:39.782016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-63a9621e-f5f9-44a5-8b10-ffa0bb1b7f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:39.787979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 883/1761] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:39 2022] DELETE /identity/v3/projects/ee3a2a1037494d8188391ef57b18b483 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:39.789983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac808-d425-48c3-bf83-86c2e336c8ed None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:39.791156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac808-d425-48c3-bf83-86c2e336c8ed None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:39.791646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac808-d425-48c3-bf83-86c2e336c8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:39.817359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7a6ac808-d425-48c3-bf83-86c2e336c8ed None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:39.819077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7a6ac808-d425-48c3-bf83-86c2e336c8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:39.903633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 879/1762] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:39.906494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768fd6-0bfb-40d9-94f9-d78629bfd95d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:39.906779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768fd6-0bfb-40d9-94f9-d78629bfd95d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:39.907061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768fd6-0bfb-40d9-94f9-d78629bfd95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:39.929781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9b768fd6-0bfb-40d9-94f9-d78629bfd95d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:39.931140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9b768fd6-0bfb-40d9-94f9-d78629bfd95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:39.943828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 884/1763] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:39.945605 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ac808-d425-48c3-bf83-86c2e336c8ed None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:39.956597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ac808-d425-48c3-bf83-86c2e336c8ed None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:39.962006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:39.962690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:39.962974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:39.963253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:39.964044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:39.964352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:39.965997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:39.984899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768fd6-0bfb-40d9-94f9-d78629bfd95d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:39.995213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768fd6-0bfb-40d9-94f9-d78629bfd95d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:39.995969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 880/1764] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:40.001021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.001704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.001984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.002261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.003562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.005802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.049079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 885/1765] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:39 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:40.051373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.093866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862ae2-9cb2-4db4-99a0-094a0ce63f93 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.251930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.252621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.252906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.253189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.253903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.256254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.286794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 881/1766] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:40 2022] POST /identity/v3/users => generated 282 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:40.287535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.300715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee56e2-ff0d-41d6-bc78-e48bba101984 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.314596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.315292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.317769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.318157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.318983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.321211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.340583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 886/1767] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:40.347617 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.363564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc24cb6-36eb-415b-afa1-571cd864327b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.370220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d34935-0222-4b7b-83df-85687e0e11e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.371048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34935-0222-4b7b-83df-85687e0e11e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.371332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34935-0222-4b7b-83df-85687e0e11e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.371989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34935-0222-4b7b-83df-85687e0e11e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.372859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d34935-0222-4b7b-83df-85687e0e11e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.374784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d34935-0222-4b7b-83df-85687e0e11e9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.392701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 882/1768] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:40.393439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.407195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396c6ea-31c5-4fea-ab0f-25ff0ac051ce admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.413075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.414429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.414752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.415301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] PATH_INFO: `/v3/projects/c4f006ce2d2a44dbae7d8327e99bec31/users/fd0b1f97d9eb43d89091ebe1c721c4c4/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.435324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f006ce2d2a44dbae7d8327e99bec31, user_id=fd0b1f97d9eb43d89091ebe1c721c4c4, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.438216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.455675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 887/1769] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:40 2022] PUT /identity/v3/projects/c4f006ce2d2a44dbae7d8327e99bec31/users/fd0b1f97d9eb43d89091ebe1c721c4c4/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:40.467522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88056fd1-d037-42fd-8f48-1118f5a06687 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.468389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88056fd1-d037-42fd-8f48-1118f5a06687 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.468672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88056fd1-d037-42fd-8f48-1118f5a06687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.496556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-88056fd1-d037-42fd-8f48-1118f5a06687 None None] MFA Rules not processed for user `fd0b1f97d9eb43d89091ebe1c721c4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:40.497767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-88056fd1-d037-42fd-8f48-1118f5a06687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:40.576888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 883/1770] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:40.578068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.655145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaa146-d0ff-4bfe-b0ae-eb7de77cb8be admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.665423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.667822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.668118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.668375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.670413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.674846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.720743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 888/1771] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:40 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:40.725191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88056fd1-d037-42fd-8f48-1118f5a06687 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.738381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88056fd1-d037-42fd-8f48-1118f5a06687 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.824830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.825728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.826019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.826301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.827919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.830053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.871432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 884/1772] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:40 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:40.877252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.893796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36859b-b15c-409b-937d-648e90c21594 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.900108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.901077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.901625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.901773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.902026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.903007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.903586 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:40.907238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.918876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd218a2-fcfb-497e-adbc-fcd243341c19 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.934890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 889/1773] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:40.937183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.939304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.939707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.940117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] PATH_INFO: `/v3/projects/ee4595b3990d46b2b504a97f8355d94e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.941717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4595b3990d46b2b504a97f8355d94e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.944389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:40.945417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:40.960133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a67fe-6833-4505-a262-9ce486b10cbd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:40.966558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:40.967591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:40.967983 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:40.969000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] PATH_INFO: `/v3/projects/b662334c4cdf44a38fba7afbdf99a94d/users/dadcc665fce9495596321056a3760252/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:40.994972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b662334c4cdf44a38fba7afbdf99a94d, user_id=dadcc665fce9495596321056a3760252, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:40.998411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:41.012828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4595b3990d46b2b504a97f8355d94e', 'request_id': 'req-1bca63cc-e733-41b5-bd17-e57ebda4215a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.018158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 890/1774] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:40 2022] PUT /identity/v3/projects/b662334c4cdf44a38fba7afbdf99a94d/users/dadcc665fce9495596321056a3760252/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:41.022805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:41.023200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4595b3990d46b2b504a97f8355d94e', 'request_id': 'req-1bca63cc-e733-41b5-bd17-e57ebda4215a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.032684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4595b3990d46b2b504a97f8355d94e', 'request_id': 'req-1bca63cc-e733-41b5-bd17-e57ebda4215a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.052617 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] The token cache is being invalidate because project ee4595b3990d46b2b504a97f8355d94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:41.052918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.055255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1bca63cc-e733-41b5-bd17-e57ebda4215a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.058773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 885/1775] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:40 2022] DELETE /identity/v3/projects/ee4595b3990d46b2b504a97f8355d94e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:41.065107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.065401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.065686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.111136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:41.128707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.182601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b6fcb-e11d-4b06-992f-a277cf53901e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:41.188526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:41.189208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.189506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.189770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.190564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:41.192904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:41.209256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 891/1776] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:41.223704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:41.226708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.244194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 886/1777] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:41.246004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:41.248252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.258548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d570bf5-59e7-4f16-85a0-a2f3be299b5c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:41.279561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669568e-cb1b-4877-90a9-87d38c84b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:41.280313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669568e-cb1b-4877-90a9-87d38c84b8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.280590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669568e-cb1b-4877-90a9-87d38c84b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.280869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669568e-cb1b-4877-90a9-87d38c84b8ff admin admin] PATH_INFO: `/v3/projects/b662334c4cdf44a38fba7afbdf99a94d/users/dadcc665fce9495596321056a3760252/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.284943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2bb6-36a6-4751-8dd4-6a565851f885 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:41.289834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669568e-cb1b-4877-90a9-87d38c84b8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b662334c4cdf44a38fba7afbdf99a94d, user_id=dadcc665fce9495596321056a3760252, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:41.294939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669568e-cb1b-4877-90a9-87d38c84b8ff admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:41.311018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:41.312593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.312843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.313121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] PATH_INFO: `/v3/projects/22a439ab25764f2fba6f3be01bbdcaa9` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.319368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a439ab25764f2fba6f3be01bbdcaa9)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:41.321678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:41.348163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 892/1778] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:41 2022] PUT /identity/v3/projects/b662334c4cdf44a38fba7afbdf99a94d/users/dadcc665fce9495596321056a3760252/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:41.348163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6ed23-e57d-4980-9314-ecccc5d493cc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.348163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6ed23-e57d-4980-9314-ecccc5d493cc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.348163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6ed23-e57d-4980-9314-ecccc5d493cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.402617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cac6ed23-e57d-4980-9314-ecccc5d493cc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:41.403139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cac6ed23-e57d-4980-9314-ecccc5d493cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.425905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a439ab25764f2fba6f3be01bbdcaa9', 'request_id': 'req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.441216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a439ab25764f2fba6f3be01bbdcaa9', 'request_id': 'req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.456682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a439ab25764f2fba6f3be01bbdcaa9', 'request_id': 'req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.488131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] The token cache is being invalidate because project 22a439ab25764f2fba6f3be01bbdcaa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:41.488604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.490382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-99f1d121-e7f4-47c8-a2e1-92a11afdf1bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:41.498448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 887/1779] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:41 2022] DELETE /identity/v3/projects/22a439ab25764f2fba6f3be01bbdcaa9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:41.498448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f51a3-1129-4672-9f7b-59cf5d9dd05d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.498448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f51a3-1129-4672-9f7b-59cf5d9dd05d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.498448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f51a3-1129-4672-9f7b-59cf5d9dd05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.537609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 893/1780] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:41.541412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca23545-bc5a-4f07-8036-b9f2c35d7c6a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.541412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca23545-bc5a-4f07-8036-b9f2c35d7c6a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.541412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca23545-bc5a-4f07-8036-b9f2c35d7c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.560800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2ca23545-bc5a-4f07-8036-b9f2c35d7c6a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:41.562266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2ca23545-bc5a-4f07-8036-b9f2c35d7c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.571954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-fb1f51a3-1129-4672-9f7b-59cf5d9dd05d None None] MFA Rules not processed for user `dadcc665fce9495596321056a3760252`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:41.579127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 894/1781] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:41.579315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fb1f51a3-1129-4672-9f7b-59cf5d9dd05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.579456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca23545-bc5a-4f07-8036-b9f2c35d7c6a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:41.604961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca23545-bc5a-4f07-8036-b9f2c35d7c6a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:41.618716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:41.620491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.621358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.621893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.623831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:41.624739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:41.628482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:41.670558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 888/1782] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:41.682430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 895/1783] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:41.682789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d11c-d25e-4ba1-8882-20baf9dd2c0c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.682789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d11c-d25e-4ba1-8882-20baf9dd2c0c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.682789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d11c-d25e-4ba1-8882-20baf9dd2c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.688468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:41.691973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.733994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a6b8d11c-d25e-4ba1-8882-20baf9dd2c0c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:41.735373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a6b8d11c-d25e-4ba1-8882-20baf9dd2c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:41.757456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 889/1784] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:41.760649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d11c-d25e-4ba1-8882-20baf9dd2c0c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:41.770949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d11c-d25e-4ba1-8882-20baf9dd2c0c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:41.777037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:41.777831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.778213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.778590 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.779586 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:41.782457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:41.828557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 890/1785] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:41 2022] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:41.828557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:41.869033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda0842-a48a-400b-ae47-af4fbb3a1481 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:41.942991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870bc8b-6a13-4982-8c61-c636b3fb22ff admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:41.949191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:41.950014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.950305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.950850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.951544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:41.951860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:41.954138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:41.970519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:41.971552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:41.972736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:41.974124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:41.990419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 891/1786] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:41.991099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.017882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e986e-494b-4bce-ae59-a0230e1940fa admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.034992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.035991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.036633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.037495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.039292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.046137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.089054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 892/1787] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:41 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:42.090800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.117092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.120208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d47507-03f0-4d04-8173-52f0e46bd23e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.121692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.133781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.135455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.136804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.138615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.140399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.148656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.152598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 896/1788] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:42.168182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.200862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c32f-37b3-4f48-beed-13f081857adc service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.223924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.224679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.225143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.225254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.226122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.228363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.247252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 897/1789] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:42.247481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 893/1790] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:42 2022] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:42.248856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.250496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.265636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468087a1-8fa9-493a-9eac-5b3987f1343e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.349411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.350513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.351007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.351546 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.352585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.356620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.376035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 898/1791] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:42.377475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.414357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa68c0-2245-40db-acfb-8983b134d3ce admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.423346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.424468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.424943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.425368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.426799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.433818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.481218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0954993-87c9-4708-9c2d-53d5003ed9a4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.485479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 894/1792] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:42 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:42.486345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.491092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.491799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.492089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.492373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.494393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:42.509366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd016cd-8578-40a5-9483-fb9f688dbdba admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.522757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972908d-e97a-4e48-b32f-53ab4eae5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.527759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972908d-e97a-4e48-b32f-53ab4eae5e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.528084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972908d-e97a-4e48-b32f-53ab4eae5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.528383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972908d-e97a-4e48-b32f-53ab4eae5e96 admin admin] PATH_INFO: `/v3/projects/557022b97a9349eebd3c1458aa9aeb9e/users/6a7dc9a22b4a495caf8fe6f841d4460d/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.566673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.568192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.580119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972908d-e97a-4e48-b32f-53ab4eae5e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557022b97a9349eebd3c1458aa9aeb9e, user_id=6a7dc9a22b4a495caf8fe6f841d4460d, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.580407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 899/1793] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:42.581284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.585710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972908d-e97a-4e48-b32f-53ab4eae5e96 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.593532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c21c1f-28ca-4329-ac56-a0b7846e480c service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.599559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.600254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.601144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.601541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.602191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.604887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.619766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 895/1794] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:42 2022] PUT /identity/v3/projects/557022b97a9349eebd3c1458aa9aeb9e/users/6a7dc9a22b4a495caf8fe6f841d4460d/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:42.620041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 900/1795] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:42.623826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.625495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232607-18ea-450c-8c92-99301219e706 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.625810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232607-18ea-450c-8c92-99301219e706 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.626136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232607-18ea-450c-8c92-99301219e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.635119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc704b5-4ece-4e51-955a-64747cf4931b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.684572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-fe232607-18ea-450c-8c92-99301219e706 None None] MFA Rules not processed for user `6a7dc9a22b4a495caf8fe6f841d4460d`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:42.690665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fe232607-18ea-450c-8c92-99301219e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:42.712076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.713003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.713719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.714270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.715857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.719327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.735195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 901/1796] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:42.742381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.768794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a7f6b-6508-447c-b51a-35f8b808398b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.785712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbae5e-b883-4aa0-8bb6-bf111716500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.790755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbae5e-b883-4aa0-8bb6-bf111716500e admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.791123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbae5e-b883-4aa0-8bb6-bf111716500e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.793299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbae5e-b883-4aa0-8bb6-bf111716500e admin admin] PATH_INFO: `/v3/projects/9892a877ed244d0facd9794714808542/users/da6cf363b2ac415f9c121cd5f5ea62e6/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.797936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 896/1797] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:42.802334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe232607-18ea-450c-8c92-99301219e706 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.825262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe232607-18ea-450c-8c92-99301219e706 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:42.832865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:42.833875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.834165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.834638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.835982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.838320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.839639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbae5e-b883-4aa0-8bb6-bf111716500e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9892a877ed244d0facd9794714808542, user_id=da6cf363b2ac415f9c121cd5f5ea62e6, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:42.843853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbae5e-b883-4aa0-8bb6-bf111716500e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:42.885084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 902/1798] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:42 2022] PUT /identity/v3/projects/9892a877ed244d0facd9794714808542/users/da6cf363b2ac415f9c121cd5f5ea62e6/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:42.886652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:42.887060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:42.887436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:42.894326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 897/1799] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:42 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:42.898650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:42.916902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:42.919177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:43.041194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 903/1800] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:43.063633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:43.066503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:43.108689 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a0c8-ba1b-4b6a-8747-328e4b4f8c7b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:43.128606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:43.131607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.134286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.136767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.140232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:43.148760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:43.199499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 898/1801] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:42 2022] POST /identity/v3/users => generated 311 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:43.201530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:43.222640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29db59-f0e7-45ee-9891-34542a2263ce None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:43.229163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:43.230219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.230824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.231271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.234752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912ac2b-67bc-48cd-9070-f80669a90892 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:43.242843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:43.244697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:43.248044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:43.250486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.251495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.251953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.253487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:43.255893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:43.257928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 904/1802] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:43.270165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 899/1803] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:43.274454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:43.285355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a02b2-e1df-4e41-91a6-c40d5bed40f0 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:43.290831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:43.291772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.292061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.292423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] PATH_INFO: `/v3/projects/20006d2b07424974b0ef80c7fbef0ac9/users/101aae3f037b4b20946c51bb6b544828/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.308817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20006d2b07424974b0ef80c7fbef0ac9, user_id=101aae3f037b4b20946c51bb6b544828, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:43.312314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:43.331524 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 905/1804] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:43 2022] PUT /identity/v3/projects/20006d2b07424974b0ef80c7fbef0ac9/users/101aae3f037b4b20946c51bb6b544828/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:43.334281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:43.346353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235eb7d-3567-4750-9138-1fd7f48572ce admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:43.424999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7887254-69cd-4afd-bbda-4d6ff447b148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:43.425842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887254-69cd-4afd-bbda-4d6ff447b148 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.426143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887254-69cd-4afd-bbda-4d6ff447b148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.426620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7887254-69cd-4afd-bbda-4d6ff447b148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.427628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7887254-69cd-4afd-bbda-4d6ff447b148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:43.429294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7887254-69cd-4afd-bbda-4d6ff447b148 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:43.456081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 900/1805] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:43.459953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:43.471423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac35a-0c84-463b-be2c-0d1d3baf2287 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:43.478774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:43.480271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.481031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.481507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] PATH_INFO: `/v3/projects/20006d2b07424974b0ef80c7fbef0ac9/users/101aae3f037b4b20946c51bb6b544828/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.484377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20006d2b07424974b0ef80c7fbef0ac9, user_id=101aae3f037b4b20946c51bb6b544828, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:43.489291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:43.503047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 906/1806] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:43 2022] PUT /identity/v3/projects/20006d2b07424974b0ef80c7fbef0ac9/users/101aae3f037b4b20946c51bb6b544828/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:43.515790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185356f1-760f-4921-ae91-0a24c4c6f9fb None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.516179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185356f1-760f-4921-ae91-0a24c4c6f9fb None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.516520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185356f1-760f-4921-ae91-0a24c4c6f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.557991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-185356f1-760f-4921-ae91-0a24c4c6f9fb None None] MFA Rules not processed for user `101aae3f037b4b20946c51bb6b544828`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:43.559857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-185356f1-760f-4921-ae91-0a24c4c6f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:43.648677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 901/1807] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:43 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:43.661666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:43.731539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4bd9f-6aa3-46d9-b7e9-fee0d1bb6b7d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:43.738351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72528b0-eca0-48e3-bcfb-fce85d66e047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:43.738967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72528b0-eca0-48e3-bcfb-fce85d66e047 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.739534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72528b0-eca0-48e3-bcfb-fce85d66e047 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.740477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72528b0-eca0-48e3-bcfb-fce85d66e047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.753426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72528b0-eca0-48e3-bcfb-fce85d66e047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:43.755012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72528b0-eca0-48e3-bcfb-fce85d66e047 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:43.765993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 907/1808] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:43.826368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec524-cee7-4a8e-8adf-7aaa1e66b26f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.826963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec524-cee7-4a8e-8adf-7aaa1e66b26f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.827489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec524-cee7-4a8e-8adf-7aaa1e66b26f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.830386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 902/1809] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:35:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:43.845541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c1791-deb2-4d45-bdb4-b960519f4e56 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:43.845541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c1791-deb2-4d45-bdb4-b960519f4e56 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:43.845541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c1791-deb2-4d45-bdb4-b960519f4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:43.905172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0d4c1791-deb2-4d45-bdb4-b960519f4e56 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:43.906618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0d4c1791-deb2-4d45-bdb4-b960519f4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:44.027507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 908/1810] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:35:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:44.071504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec524-cee7-4a8e-8adf-7aaa1e66b26f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:44.075642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0a7ec524-cee7-4a8e-8adf-7aaa1e66b26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:44.101949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec524-cee7-4a8e-8adf-7aaa1e66b26f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:44.111290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f25a1-390f-4a72-8811-e5adbbae06e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:44.112321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f25a1-390f-4a72-8811-e5adbbae06e1 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:44.112679 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f25a1-390f-4a72-8811-e5adbbae06e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:44.113033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f25a1-390f-4a72-8811-e5adbbae06e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:44.124772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f25a1-390f-4a72-8811-e5adbbae06e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:44.126809 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f25a1-390f-4a72-8811-e5adbbae06e1 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:44.141801 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c1791-deb2-4d45-bdb4-b960519f4e56 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:44.143225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 903/1811] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:44.154063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c1791-deb2-4d45-bdb4-b960519f4e56 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:44.164751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:44.165762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:44.166118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:44.166968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:44.286774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:44.289160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:44.299863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 909/1812] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:44 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:44.517761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857d18-2b1c-42b7-9d2c-54ddada6e9f8 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:44.518058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857d18-2b1c-42b7-9d2c-54ddada6e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:44.518338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857d18-2b1c-42b7-9d2c-54ddada6e9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:44.547241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e2857d18-2b1c-42b7-9d2c-54ddada6e9f8 None None] MFA Rules not processed for user `da6cf363b2ac415f9c121cd5f5ea62e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:44.549112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e2857d18-2b1c-42b7-9d2c-54ddada6e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:44.644412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 904/1813] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:44.648508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:44.725768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74901a-cf75-499f-bbfc-e2e448d0d701 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:44.730450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:44.731164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:44.731470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:44.731757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:44.732470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:44.734407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:44.759462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 910/1814] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:44 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:44.763714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857d18-2b1c-42b7-9d2c-54ddada6e9f8 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:44.774790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857d18-2b1c-42b7-9d2c-54ddada6e9f8 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:44.830525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:44.831189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:44.831502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:44.831781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:44.832485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:44.834396 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:44.853335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 905/1815] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:44 2022] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:44.857191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:44.867244 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ce867-c5d2-489f-af13-05d94b109555 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:44.871853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:44.872512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:44.872792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:44.873074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:44.874317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:44.875948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:44.886474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 911/1816] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:44.891115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:44.900920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16c1f5-fef4-4392-995d-069a7327d36a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:44.905825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:44.906694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:44.906974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:44.907249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] PATH_INFO: `/v3/projects/c3978dbc9f3845f7a80e4fa6f6fe1993/users/31ece423abaa45548c4af57bba965ec3/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:44.921695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3978dbc9f3845f7a80e4fa6f6fe1993, user_id=31ece423abaa45548c4af57bba965ec3, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:44.924398 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:44.938503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 906/1817] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:44 2022] PUT /identity/v3/projects/c3978dbc9f3845f7a80e4fa6f6fe1993/users/31ece423abaa45548c4af57bba965ec3/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:44.942439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:44.953167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d780f3e-660c-4dcb-a385-bf6acad8cfb3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:45.011709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b17b5-1647-4fab-9e5a-382b9b7d783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:45.012399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b17b5-1647-4fab-9e5a-382b9b7d783a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:45.012686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b17b5-1647-4fab-9e5a-382b9b7d783a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:45.012969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b17b5-1647-4fab-9e5a-382b9b7d783a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:45.014322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b17b5-1647-4fab-9e5a-382b9b7d783a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:45.017381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b17b5-1647-4fab-9e5a-382b9b7d783a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:45.029427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 912/1818] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:45.034133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:45.045815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f41ee3-0e63-48ad-8b58-5ccb96b16b3d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:45.049857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:45.050831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:45.051186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:45.051558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] PATH_INFO: `/v3/projects/c3978dbc9f3845f7a80e4fa6f6fe1993/users/31ece423abaa45548c4af57bba965ec3/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:45.053603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3978dbc9f3845f7a80e4fa6f6fe1993, user_id=31ece423abaa45548c4af57bba965ec3, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:45.056350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:45.067658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 907/1819] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:45 2022] PUT /identity/v3/projects/c3978dbc9f3845f7a80e4fa6f6fe1993/users/31ece423abaa45548c4af57bba965ec3/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:45.785393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946af2d-3318-48b2-8a9f-a65d12cf6433 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:45.785889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946af2d-3318-48b2-8a9f-a65d12cf6433 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:45.787701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946af2d-3318-48b2-8a9f-a65d12cf6433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:45.818237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6946af2d-3318-48b2-8a9f-a65d12cf6433 None None] MFA Rules not processed for user `31ece423abaa45548c4af57bba965ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:45.820212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6946af2d-3318-48b2-8a9f-a65d12cf6433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:45.891036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 913/1820] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:48.110285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:48.214005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83595e-c0b5-4476-b94d-29e2d9cb71cd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:48.229897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:48.230798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:48.231082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:48.231364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] PATH_INFO: `/v3/users/da6cf363b2ac415f9c121cd5f5ea62e6` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:48.240228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6cf363b2ac415f9c121cd5f5ea62e6)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:48.245707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:48.314702 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6cf363b2ac415f9c121cd5f5ea62e6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.322602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6cf363b2ac415f9c121cd5f5ea62e6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.345701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6cf363b2ac415f9c121cd5f5ea62e6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.356138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6cf363b2ac415f9c121cd5f5ea62e6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.356911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6cf363b2ac415f9c121cd5f5ea62e6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.363868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 908/1821] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:48 2022] DELETE /identity/v3/users/da6cf363b2ac415f9c121cd5f5ea62e6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:48.562073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946af2d-3318-48b2-8a9f-a65d12cf6433 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:48.569961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946af2d-3318-48b2-8a9f-a65d12cf6433 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:48.628039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:48.628893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:48.629186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:48.629530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] PATH_INFO: `/v3/projects/9892a877ed244d0facd9794714808542` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:48.632262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9892a877ed244d0facd9794714808542)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:48.634268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:48.680194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9892a877ed244d0facd9794714808542', 'request_id': 'req-8e401896-76d4-4d6e-8e96-077f473135d0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.688100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9892a877ed244d0facd9794714808542', 'request_id': 'req-8e401896-76d4-4d6e-8e96-077f473135d0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.693654 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9892a877ed244d0facd9794714808542', 'request_id': 'req-8e401896-76d4-4d6e-8e96-077f473135d0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.704790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] The token cache is being invalidate because project 9892a877ed244d0facd9794714808542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:48.705081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.705804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.707734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 914/1822] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:48 2022] DELETE /identity/v3/projects/9892a877ed244d0facd9794714808542 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:48.711472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:48.712869 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:48.727294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aadcfb-347d-4ae6-a0c2-2468a5e2015a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:48.782239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:48.783106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:48.783410 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:48.783690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] PATH_INFO: `/v3/users/31ece423abaa45548c4af57bba965ec3` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:48.784885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ece423abaa45548c4af57bba965ec3)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:48.786790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:48.830303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ece423abaa45548c4af57bba965ec3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.836873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ece423abaa45548c4af57bba965ec3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.848624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ece423abaa45548c4af57bba965ec3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.855880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ece423abaa45548c4af57bba965ec3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.856537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-bad5d1c4-be4d-4538-a385-aa7115e6e6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ece423abaa45548c4af57bba965ec3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:48.862894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 909/1823] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:48 2022] DELETE /identity/v3/users/31ece423abaa45548c4af57bba965ec3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:49.027002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:49.028464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:49.042373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401896-76d4-4d6e-8e96-077f473135d0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:49.097535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:49.098413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.098697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.098977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] PATH_INFO: `/v3/projects/c3978dbc9f3845f7a80e4fa6f6fe1993` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.100192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3978dbc9f3845f7a80e4fa6f6fe1993)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:49.102146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:49.151897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3978dbc9f3845f7a80e4fa6f6fe1993', 'request_id': 'req-550f38e1-9bb7-446a-a715-732e568370a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:49.163282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3978dbc9f3845f7a80e4fa6f6fe1993', 'request_id': 'req-550f38e1-9bb7-446a-a715-732e568370a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:49.167167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3978dbc9f3845f7a80e4fa6f6fe1993', 'request_id': 'req-550f38e1-9bb7-446a-a715-732e568370a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:49.183328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] The token cache is being invalidate because project c3978dbc9f3845f7a80e4fa6f6fe1993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:49.183791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:49.185604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550f38e1-9bb7-446a-a715-732e568370a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:49.196682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 915/1824] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:49 2022] DELETE /identity/v3/projects/c3978dbc9f3845f7a80e4fa6f6fe1993 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:49.203226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc615-571d-4cd4-9dba-69df22548d80 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.204279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc615-571d-4cd4-9dba-69df22548d80 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.204727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc615-571d-4cd4-9dba-69df22548d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.232877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-be2dc615-571d-4cd4-9dba-69df22548d80 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:49.234650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-be2dc615-571d-4cd4-9dba-69df22548d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:49.307793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 910/1825] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:49.316622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c988d-14e0-4918-aca1-9fd90e37ed65 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.317029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c988d-14e0-4918-aca1-9fd90e37ed65 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.317307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c988d-14e0-4918-aca1-9fd90e37ed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.338977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-501c988d-14e0-4918-aca1-9fd90e37ed65 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:49.340861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-501c988d-14e0-4918-aca1-9fd90e37ed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:49.353307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 916/1826] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:49.355576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc615-571d-4cd4-9dba-69df22548d80 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:49.366920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc615-571d-4cd4-9dba-69df22548d80 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:49.377998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:49.379559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.379925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.380214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.380968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:49.381388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:49.383002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:49.404469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c988d-14e0-4918-aca1-9fd90e37ed65 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:49.406175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 911/1827] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:49.420671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c988d-14e0-4918-aca1-9fd90e37ed65 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:49.429486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:49.430333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.430731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.431081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.431893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:49.434042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:49.468950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 917/1828] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:49 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:49.472641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:49.527688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8185f0-0e03-4d47-a242-9a284cdb3179 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:49.656270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:49.657271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.657730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.658205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.659117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:49.661536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:49.697764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 912/1829] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:49 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:49.702212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:49.721242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a270-9494-4d89-841c-f37f50b4a6e4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:49.727349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:49.728452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.728889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.729182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.730146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:49.732072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:49.765685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 918/1830] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:49.770524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:49.786322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695eae-e455-4c06-b952-590cd8933cdd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:49.799077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5580d46-7bca-4e84-8dce-44d13925ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:49.799815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5580d46-7bca-4e84-8dce-44d13925ff92 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.800010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5580d46-7bca-4e84-8dce-44d13925ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.800279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5580d46-7bca-4e84-8dce-44d13925ff92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.801030 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5580d46-7bca-4e84-8dce-44d13925ff92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:49.810924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5580d46-7bca-4e84-8dce-44d13925ff92 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:49.824553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 913/1831] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:49.828461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:49.840936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314effab-20a2-4eda-a63e-2fbf30451283 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:49.857405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:49.858909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.859188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.859498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] PATH_INFO: `/v3/projects/30c92c722cd844a0a8db2cee5600c164/users/e9e1b9adc58742dbb3770e76a7121d07/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.896237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c92c722cd844a0a8db2cee5600c164, user_id=e9e1b9adc58742dbb3770e76a7121d07, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:49.898952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:49.918561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 919/1832] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:49 2022] PUT /identity/v3/projects/30c92c722cd844a0a8db2cee5600c164/users/e9e1b9adc58742dbb3770e76a7121d07/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:49.930390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443340b-5aa1-44c0-a928-0ffc875ab71c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:49.930683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443340b-5aa1-44c0-a928-0ffc875ab71c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:49.930964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443340b-5aa1-44c0-a928-0ffc875ab71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:49.963603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6443340b-5aa1-44c0-a928-0ffc875ab71c None None] MFA Rules not processed for user `e9e1b9adc58742dbb3770e76a7121d07`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:49.964877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6443340b-5aa1-44c0-a928-0ffc875ab71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:50.025584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 914/1833] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:50.030751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.088794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e8e54-c35d-41be-83c1-e328e46b2785 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.093941 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.094587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.094872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.095150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.095892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.097770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.123489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 920/1834] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:50 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:50.127663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443340b-5aa1-44c0-a928-0ffc875ab71c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.138463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443340b-5aa1-44c0-a928-0ffc875ab71c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.196206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.196206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.196206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.196570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.197133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.199062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.222314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 915/1835] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:50 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:50.226228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.236927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586395-4a3c-4b32-be2e-68a55ed819a1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.241559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.242216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.242501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.242808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.243597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.245193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.255729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 921/1836] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:50.259956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.269600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56780-9c3f-4eae-9ba5-ac4e2a6c2b35 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.274158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.275022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.275305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.275620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] PATH_INFO: `/v3/projects/c0cd1500173e4c9098e5fbb5ef8e3083/users/d92239cf20fc4bdfa96c9c1a545e57a7/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.291489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cd1500173e4c9098e5fbb5ef8e3083, user_id=d92239cf20fc4bdfa96c9c1a545e57a7, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.294129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.306992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 916/1837] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:50 2022] PUT /identity/v3/projects/c0cd1500173e4c9098e5fbb5ef8e3083/users/d92239cf20fc4bdfa96c9c1a545e57a7/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:50.310851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.320457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8fd6f-eae2-45ef-af0a-09eba8eaeaa6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.375013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303789b6-6042-4471-bf83-316482feb9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.375719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303789b6-6042-4471-bf83-316482feb9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.376004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303789b6-6042-4471-bf83-316482feb9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.376288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303789b6-6042-4471-bf83-316482feb9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.377342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303789b6-6042-4471-bf83-316482feb9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.378982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303789b6-6042-4471-bf83-316482feb9fe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.388882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 922/1838] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:50.393364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.404072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d5ad-2d3c-4c98-b210-9d35a1d065cc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.409644 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.410618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.410971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.411330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] PATH_INFO: `/v3/projects/c0cd1500173e4c9098e5fbb5ef8e3083/users/d92239cf20fc4bdfa96c9c1a545e57a7/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.413420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cd1500173e4c9098e5fbb5ef8e3083, user_id=d92239cf20fc4bdfa96c9c1a545e57a7, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.416221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.426889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 917/1839] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:50 2022] PUT /identity/v3/projects/c0cd1500173e4c9098e5fbb5ef8e3083/users/d92239cf20fc4bdfa96c9c1a545e57a7/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:50.437579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c2681-e83d-4147-82f9-f82f34591bf5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.437865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c2681-e83d-4147-82f9-f82f34591bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.438158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c2681-e83d-4147-82f9-f82f34591bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.465221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-006c2681-e83d-4147-82f9-f82f34591bf5 None None] MFA Rules not processed for user `d92239cf20fc4bdfa96c9c1a545e57a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:50.466504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-006c2681-e83d-4147-82f9-f82f34591bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:50.532794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 923/1840] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:50.559085 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.560885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:50.616565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688f9f4-3df5-4d38-b6cd-111de4674ecd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.620299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.620951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.621236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.621521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.630628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.632258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.642418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 918/1841] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:50.718529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c2681-e83d-4147-82f9-f82f34591bf5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:50.728769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c2681-e83d-4147-82f9-f82f34591bf5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:50.732538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f5f1b-b02f-4a7b-9031-2a4b2079507e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:50.733214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f5f1b-b02f-4a7b-9031-2a4b2079507e service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:50.733500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f5f1b-b02f-4a7b-9031-2a4b2079507e service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:50.733781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f5f1b-b02f-4a7b-9031-2a4b2079507e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:50.787885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f5f1b-b02f-4a7b-9031-2a4b2079507e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:50.789251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f5f1b-b02f-4a7b-9031-2a4b2079507e service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:50.797925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 924/1842] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:53.104741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:53.106248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:53.187608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7b170-3de5-43eb-ac9d-ea5921e4ad75 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:53.192258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:53.193153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:53.193436 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:53.193717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] PATH_INFO: `/v3/users/fd0b1f97d9eb43d89091ebe1c721c4c4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:53.194928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0b1f97d9eb43d89091ebe1c721c4c4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:53.196886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:53.267223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0b1f97d9eb43d89091ebe1c721c4c4'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:53.281905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0b1f97d9eb43d89091ebe1c721c4c4'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:53.299366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0b1f97d9eb43d89091ebe1c721c4c4'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:53.309885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0b1f97d9eb43d89091ebe1c721c4c4'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:53.310953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0b1f97d9eb43d89091ebe1c721c4c4'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:53.324620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 919/1843] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:53 2022] DELETE /identity/v3/users/fd0b1f97d9eb43d89091ebe1c721c4c4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:53.329545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958f17-efd2-4cd0-93f4-066a599f7399 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:53.330006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958f17-efd2-4cd0-93f4-066a599f7399 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:53.330194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958f17-efd2-4cd0-93f4-066a599f7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:53.360024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-57958f17-efd2-4cd0-93f4-066a599f7399 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:53.362342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-57958f17-efd2-4cd0-93f4-066a599f7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:53.446395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 925/1844] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:53.457262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:53.459754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:53.619313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3115-a12d-4efd-8501-72046fa56d54 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:53.624153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d991ff-13be-4f30-b4b7-8b807ffd2b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:53.628940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d991ff-13be-4f30-b4b7-8b807ffd2b55 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:53.629351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d991ff-13be-4f30-b4b7-8b807ffd2b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:53.629998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d991ff-13be-4f30-b4b7-8b807ffd2b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:53.652236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d991ff-13be-4f30-b4b7-8b807ffd2b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:53.653810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d991ff-13be-4f30-b4b7-8b807ffd2b55 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:53.672252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 920/1845] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:53.677153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be185-b8bb-4e31-a367-93e9d73905e5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:53.677795 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be185-b8bb-4e31-a367-93e9d73905e5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:53.678305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be185-b8bb-4e31-a367-93e9d73905e5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:53.683028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 926/1846] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:35:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:35:53.706737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:53.707483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:53.707827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:53.735294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:53.736829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:53.843227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 921/1847] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:35:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:53.876571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002be185-b8bb-4e31-a367-93e9d73905e5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:53.881733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-002be185-b8bb-4e31-a367-93e9d73905e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:53.913448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002be185-b8bb-4e31-a367-93e9d73905e5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:53.925223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:53.926116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:53.926406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:53.926689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:53.940758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:53.942542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:53.969032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 927/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:54.087051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:54.088524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:54.116405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dc009-3eba-4aaa-83eb-0c7193f02e87 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:54.129975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:54.131599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:54.132048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:54.132328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] PATH_INFO: `/v3/projects/c4f006ce2d2a44dbae7d8327e99bec31` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:54.136606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f006ce2d2a44dbae7d8327e99bec31)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:54.142213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:54.200938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f006ce2d2a44dbae7d8327e99bec31', 'request_id': 'req-6b12da63-b948-47d4-b10c-aa7b56308acb'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.208249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f006ce2d2a44dbae7d8327e99bec31', 'request_id': 'req-6b12da63-b948-47d4-b10c-aa7b56308acb'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.215324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f006ce2d2a44dbae7d8327e99bec31', 'request_id': 'req-6b12da63-b948-47d4-b10c-aa7b56308acb'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.228516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] The token cache is being invalidate because project c4f006ce2d2a44dbae7d8327e99bec31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:54.228851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.229474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.231064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 922/1849] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:54 2022] DELETE /identity/v3/projects/c4f006ce2d2a44dbae7d8327e99bec31 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:54.235872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:54.247757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc1067-2bf5-46dc-8657-a166cc5f5c40 service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:54.304488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:54.305362 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:54.305647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:54.305944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] PATH_INFO: `/v3/users/dadcc665fce9495596321056a3760252` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:54.309490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadcc665fce9495596321056a3760252)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:54.312093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:54.360295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadcc665fce9495596321056a3760252'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.368032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadcc665fce9495596321056a3760252'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.375540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadcc665fce9495596321056a3760252'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.389141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadcc665fce9495596321056a3760252'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.393790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadcc665fce9495596321056a3760252'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.399784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 928/1850] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:54 2022] DELETE /identity/v3/users/dadcc665fce9495596321056a3760252 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:54.689056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:54.690768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:54.712572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12da63-b948-47d4-b10c-aa7b56308acb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:54.808384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:54.809330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:54.809612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:54.809943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] PATH_INFO: `/v3/projects/b662334c4cdf44a38fba7afbdf99a94d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:54.811175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b662334c4cdf44a38fba7afbdf99a94d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:54.813125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:54.873954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b662334c4cdf44a38fba7afbdf99a94d', 'request_id': 'req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.875196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:54.876745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:54.881051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b662334c4cdf44a38fba7afbdf99a94d', 'request_id': 'req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.888469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b662334c4cdf44a38fba7afbdf99a94d', 'request_id': 'req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.903511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] The token cache is being invalidate because project b662334c4cdf44a38fba7afbdf99a94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:54.903930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.904902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0a2ddbec-68d9-40fa-b6f6-89a91dd0a8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:54.907909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 923/1851] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:54 2022] DELETE /identity/v3/projects/b662334c4cdf44a38fba7afbdf99a94d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:54.913020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6237d-85da-474d-bed8-76dcdf3330fa None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:54.913375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6237d-85da-474d-bed8-76dcdf3330fa None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:54.913595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6237d-85da-474d-bed8-76dcdf3330fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:54.915509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e053da-4bac-498a-8d55-3bfe566a8c2a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:54.942112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f4e6237d-85da-474d-bed8-76dcdf3330fa None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:54.943477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f4e6237d-85da-474d-bed8-76dcdf3330fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:54.975158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:54.976082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:54.976488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:54.976847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] PATH_INFO: `/v3/users/e9e1b9adc58742dbb3770e76a7121d07` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:54.978176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e1b9adc58742dbb3770e76a7121d07)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:54.980147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.010401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 924/1852] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:55.021990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd960e5-0c96-484c-bd2f-10de8ac83be8 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.022381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd960e5-0c96-484c-bd2f-10de8ac83be8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.022697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd960e5-0c96-484c-bd2f-10de8ac83be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.036051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e1b9adc58742dbb3770e76a7121d07'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:55.043881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7cd960e5-0c96-484c-bd2f-10de8ac83be8 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:55.044318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e1b9adc58742dbb3770e76a7121d07'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:55.044996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7cd960e5-0c96-484c-bd2f-10de8ac83be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:55.054565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e1b9adc58742dbb3770e76a7121d07'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:55.058168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 925/1853] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:55.059513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd960e5-0c96-484c-bd2f-10de8ac83be8 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.068157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e1b9adc58742dbb3770e76a7121d07'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:55.069992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd960e5-0c96-484c-bd2f-10de8ac83be8 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.070420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4080a8ff-5a1d-4722-9bd8-f0ebc30b51ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e1b9adc58742dbb3770e76a7121d07'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:55.076004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.077872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.078609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.078954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.079756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:55.080094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.081701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.087902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 929/1854] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:54 2022] DELETE /identity/v3/users/e9e1b9adc58742dbb3770e76a7121d07 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:55.092610 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.092984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.093337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.094432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 926/1855] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:55.098966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.100437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:55.111738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:55.113038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:55.114466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485137c3-8508-4526-b4eb-d72f69f1f5a6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.169029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.169717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.169962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.170773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.170896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 930/1856] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:55.171502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.173408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.182205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.183699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:55.202737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 927/1857] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:55 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:55.206965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.244532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f7f91-2608-49a5-92a6-35cc9571088d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.270381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04f18-3420-4f72-ba3a-9d52588f27d9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.275355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.276345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.276943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.277359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.278382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.280898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.300595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.301478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.301959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.302322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.307929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 928/1858] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:55 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:55.311927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.313600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.315276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.325890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 931/1859] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:55.327110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f03aee-675a-49a0-8777-da9097cfa45c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.331671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.332311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.332598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.332882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.333632 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.335242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.346540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 929/1860] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:55.350544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.374978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5b6dc-34e9-4fe1-9ed8-3fbb179d829e service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.380799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dc719-24ea-477f-80de-d4ddcbd18a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.381560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc719-24ea-477f-80de-d4ddcbd18a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.382060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc719-24ea-477f-80de-d4ddcbd18a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.382492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dc719-24ea-477f-80de-d4ddcbd18a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.383240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dc719-24ea-477f-80de-d4ddcbd18a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.385051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dc719-24ea-477f-80de-d4ddcbd18a65 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.406422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 932/1861] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:55.408560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.428436 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d1766-965c-445b-8e23-5830ce88175a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.433395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.434472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.434766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.435050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] PATH_INFO: `/v3/projects/2ecf664fd07e47f18c8f549ea6c37f79/users/6f9d817e0a7f4eabb1e1a90ea0a1b220/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.452883 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecf664fd07e47f18c8f549ea6c37f79, user_id=6f9d817e0a7f4eabb1e1a90ea0a1b220, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.455786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.486926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 930/1862] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:55 2022] PUT /identity/v3/projects/2ecf664fd07e47f18c8f549ea6c37f79/users/6f9d817e0a7f4eabb1e1a90ea0a1b220/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:55.488804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.489095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.489389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.546216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] MFA Rules not processed for user `6f9d817e0a7f4eabb1e1a90ea0a1b220`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:55.548320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:55.634192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 933/1863] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:55.638729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.679765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.681852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:55.712232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07921919-ece4-46e1-a216-c288c71171da admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.717986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.718629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.719040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.719336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.720462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.722222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.753449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 931/1864] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:55 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:55.755016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.756064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75d172-17e4-445c-8eb1-fc7a897a156a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.847585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.847787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a3895-664f-4fc9-b95d-389fda2b1060 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.848805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.850104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.850537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] PATH_INFO: `/v3/projects/30c92c722cd844a0a8db2cee5600c164` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.853230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.853662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c92c722cd844a0a8db2cee5600c164)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.853915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.854321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.854611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.855522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.857067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.858012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.893782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 932/1865] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:55 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:55.894912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.909867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b412-31c9-4617-bb5e-5c782a733b42 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.915229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:55.916030 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:55.916331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:55.916635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:55.917514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:55.919889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:55.934774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 933/1866] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:55.940325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:55.955127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101741e-6461-4ef7-b9b5-b690cb059a89 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:55.955319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c92c722cd844a0a8db2cee5600c164', 'request_id': 'req-bd9e052f-327b-4e51-b508-4b0a4f1a7581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:55.975028 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c92c722cd844a0a8db2cee5600c164', 'request_id': 'req-bd9e052f-327b-4e51-b508-4b0a4f1a7581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:55.986762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c92c722cd844a0a8db2cee5600c164', 'request_id': 'req-bd9e052f-327b-4e51-b508-4b0a4f1a7581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.014475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] The token cache is being invalidate because project 30c92c722cd844a0a8db2cee5600c164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:56.014879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.016109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.024684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 934/1867] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:55 2022] DELETE /identity/v3/projects/30c92c722cd844a0a8db2cee5600c164 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:56.026991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:56.028424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.078171 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:56.079126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.079437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.079718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] PATH_INFO: `/v3/projects/071aa8fcb4124010abad0f81200aaeb6/users/3b140aaa353549f695645c2142f60c64/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.110642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071aa8fcb4124010abad0f81200aaeb6, user_id=3b140aaa353549f695645c2142f60c64, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:56.114904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:56.144035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 934/1868] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:55 2022] PUT /identity/v3/projects/071aa8fcb4124010abad0f81200aaeb6/users/3b140aaa353549f695645c2142f60c64/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:56.148479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:56.149065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e052f-327b-4e51-b508-4b0a4f1a7581 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:56.165481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.242800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:56.243737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.244167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.244491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] PATH_INFO: `/v3/users/d92239cf20fc4bdfa96c9c1a545e57a7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.249911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92239cf20fc4bdfa96c9c1a545e57a7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:56.252709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:56.275964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db0bf2-f61b-4907-95f7-e1739a117fb4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:56.283237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:56.284370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.285071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.285189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.286145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:56.288345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:56.310180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 935/1869] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:56.312135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:56.314027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.340456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92239cf20fc4bdfa96c9c1a545e57a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.340725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f06a5-9458-41c6-af96-ba33a4e72ba5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:56.353841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:56.356420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.356796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.357221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] PATH_INFO: `/v3/users/6a7dc9a22b4a495caf8fe6f841d4460d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.360022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92239cf20fc4bdfa96c9c1a545e57a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.360700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7dc9a22b4a495caf8fe6f841d4460d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:56.371695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92239cf20fc4bdfa96c9c1a545e57a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.382525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:56.388535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92239cf20fc4bdfa96c9c1a545e57a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.391723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92239cf20fc4bdfa96c9c1a545e57a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.403861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 935/1870] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:56 2022] DELETE /identity/v3/users/d92239cf20fc4bdfa96c9c1a545e57a7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:56.405344 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:56.408195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.481734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7dc9a22b4a495caf8fe6f841d4460d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.498520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7dc9a22b4a495caf8fe6f841d4460d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.499535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6a61f-174b-43af-b80c-18fdf0d6d4fa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:56.505015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633b9d6-3cf1-4f96-a481-aba41d87e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:56.506517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633b9d6-3cf1-4f96-a481-aba41d87e3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.507036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633b9d6-3cf1-4f96-a481-aba41d87e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.507564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633b9d6-3cf1-4f96-a481-aba41d87e3ee admin admin] PATH_INFO: `/v3/projects/071aa8fcb4124010abad0f81200aaeb6/users/3b140aaa353549f695645c2142f60c64/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.510222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633b9d6-3cf1-4f96-a481-aba41d87e3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=071aa8fcb4124010abad0f81200aaeb6, user_id=3b140aaa353549f695645c2142f60c64, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:56.518947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633b9d6-3cf1-4f96-a481-aba41d87e3ee admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:56.525149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7dc9a22b4a495caf8fe6f841d4460d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.536127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 936/1871] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:56 2022] PUT /identity/v3/projects/071aa8fcb4124010abad0f81200aaeb6/users/3b140aaa353549f695645c2142f60c64/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:56.549321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.549704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.550094 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.566272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7dc9a22b4a495caf8fe6f841d4460d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.567212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0f7d92f4-f911-40f2-9b78-99806863e11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7dc9a22b4a495caf8fe6f841d4460d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:56.583953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 936/1872] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:56 2022] DELETE /identity/v3/users/6a7dc9a22b4a495caf8fe6f841d4460d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:56.592609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.594686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] MFA Rules not processed for user `3b140aaa353549f695645c2142f60c64`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:56.595986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.598066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.598407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.643643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:56.646758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.706984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 937/1873] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:56.717928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:56.719566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.751023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 937/1874] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:56.770445 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:56.772195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:56.806790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0e07-8d16-438b-9c9d-1ffc7de73fa6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:56.811931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:56.813098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.813391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.814199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.830091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:56.833254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:56.848080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 938/1875] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:56.877847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530a8e8-0e04-47d6-be20-614a1dfca060 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:56.882292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:56.883073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:56.883529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:56.883892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:56.915714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:56.916373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:56.927760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 938/1876] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:57.212374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:57.214340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.239423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226ceac-e8f8-44b3-b4d8-248783cd66c5 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:57.247706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:57.248318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.248537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.248804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] PATH_INFO: `/v3/projects/c0cd1500173e4c9098e5fbb5ef8e3083` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.250165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cd1500173e4c9098e5fbb5ef8e3083)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:57.252687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:57.300578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:57.302051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.316522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344ebe5-2ff2-4f34-a2ef-68af389bafff service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:57.322068 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cd1500173e4c9098e5fbb5ef8e3083', 'request_id': 'req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.332602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cd1500173e4c9098e5fbb5ef8e3083', 'request_id': 'req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.339713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cd1500173e4c9098e5fbb5ef8e3083', 'request_id': 'req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.362714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] The token cache is being invalidate because project c0cd1500173e4c9098e5fbb5ef8e3083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:57.363008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.363950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.366257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 939/1877] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:57 2022] DELETE /identity/v3/projects/c0cd1500173e4c9098e5fbb5ef8e3083 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:57.367205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:57.368579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.399105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:57.400163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.400453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.400949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] PATH_INFO: `/v3/users/6f9d817e0a7f4eabb1e1a90ea0a1b220` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.402245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9d817e0a7f4eabb1e1a90ea0a1b220)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:57.404454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:57.437955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58f7e-38af-452d-8884-9db9cdaf4c0c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:57.443419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:57.444381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.444721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.445000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] PATH_INFO: `/v3/projects/557022b97a9349eebd3c1458aa9aeb9e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.446924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557022b97a9349eebd3c1458aa9aeb9e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:57.449103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:57.456360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9d817e0a7f4eabb1e1a90ea0a1b220'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.464324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9d817e0a7f4eabb1e1a90ea0a1b220'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.478820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9d817e0a7f4eabb1e1a90ea0a1b220'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.485892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9d817e0a7f4eabb1e1a90ea0a1b220'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.488914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9223e1e0-8c57-4a84-823e-80b29a93d76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9d817e0a7f4eabb1e1a90ea0a1b220'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.495363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 939/1878] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:57 2022] DELETE /identity/v3/users/6f9d817e0a7f4eabb1e1a90ea0a1b220 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:35:57.499045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.499045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.499045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.504622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557022b97a9349eebd3c1458aa9aeb9e', 'request_id': 'req-32364940-f54b-4b30-bc2b-00d2c1e66f67'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.512512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557022b97a9349eebd3c1458aa9aeb9e', 'request_id': 'req-32364940-f54b-4b30-bc2b-00d2c1e66f67'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.517939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:57.519155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.520174 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557022b97a9349eebd3c1458aa9aeb9e', 'request_id': 'req-32364940-f54b-4b30-bc2b-00d2c1e66f67'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.532657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] The token cache is being invalidate because project 557022b97a9349eebd3c1458aa9aeb9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:57.532945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.533638 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32364940-f54b-4b30-bc2b-00d2c1e66f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.535583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 940/1879] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:57 2022] DELETE /identity/v3/projects/557022b97a9349eebd3c1458aa9aeb9e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:57.539422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185fec-4a53-4778-8e0a-88e691c72eab None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.539949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185fec-4a53-4778-8e0a-88e691c72eab None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.540050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185fec-4a53-4778-8e0a-88e691c72eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.557312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-09185fec-4a53-4778-8e0a-88e691c72eab None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:57.558504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-09185fec-4a53-4778-8e0a-88e691c72eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.594227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 940/1880] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:57.594227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:57.594227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.609522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e472d-da58-44b4-ac28-145de389a416 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:57.615056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:57.616154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.616537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.616913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] PATH_INFO: `/v3/users/101aae3f037b4b20946c51bb6b544828` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.618383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101aae3f037b4b20946c51bb6b544828)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:57.620568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:57.675066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 941/1881] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:57.676600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.676962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.677559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.694161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101aae3f037b4b20946c51bb6b544828'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.703170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101aae3f037b4b20946c51bb6b544828'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.705675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:57.707788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.717186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101aae3f037b4b20946c51bb6b544828'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.718377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 942/1882] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:57.719377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:57.720966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.732059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101aae3f037b4b20946c51bb6b544828'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.732723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101aae3f037b4b20946c51bb6b544828'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:57.744951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 941/1883] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:57 2022] DELETE /identity/v3/users/101aae3f037b4b20946c51bb6b544828 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:57.745594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:57.747888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.836257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10839c3-1b1e-4ff2-8e4b-71d133dffced None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:57.843626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15fae-832b-4d70-b4a0-9cd22dd19b06 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:57.849654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:57.850844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.850844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.851228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.852104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:57.852706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:57.854664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:57.869539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 942/1884] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:57.875367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:57.895241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485b4b-1a30-4216-8202-c8317914f170 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:57.903989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:57.906256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.906640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.907257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.908888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:57.911301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:57.971698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:57.972397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:57.973044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:57.973767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:57.979566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:57.999485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.001784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.009023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 943/1885] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:57 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:58.013180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.021401 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 943/1886] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:58.123069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b30f8-7c3d-466a-8507-9277d9dc3496 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.132220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.132388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.132862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.133205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.134076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.137248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.213620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 944/1887] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:58 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:58.213813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.224366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217b8e-4f36-4adb-baa3-06c708661ac5 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.236062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.236997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.237132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.239766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.240705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.243707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.278612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 944/1888] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:58.281323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.324230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a5d6-8bc7-46e3-8ef4-ab0daa469d6b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.332402 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.333505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.334244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.334969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.336157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.338621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.355001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 945/1889] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:58.356510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.371227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb20b7e-b8f0-4351-b34b-6df2675f070d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.378906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec1894-eb31-4741-b6a8-e086b30dfb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.380580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1894-eb31-4741-b6a8-e086b30dfb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.380978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1894-eb31-4741-b6a8-e086b30dfb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.381356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1894-eb31-4741-b6a8-e086b30dfb2b admin admin] PATH_INFO: `/v3/projects/cf2b2426392f4f8c8f3f897dec2be723/users/fe1e8d5fbf4340c480e2e21496011d28/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.406188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec1894-eb31-4741-b6a8-e086b30dfb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2b2426392f4f8c8f3f897dec2be723, user_id=fe1e8d5fbf4340c480e2e21496011d28, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.407229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.409316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.418439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec1894-eb31-4741-b6a8-e086b30dfb2b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.428612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a57a-eae5-471f-a9ec-8007d373ae10 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.434291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.435306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.435892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.436266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] PATH_INFO: `/v3/projects/20006d2b07424974b0ef80c7fbef0ac9` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.438018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 945/1890] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:58 2022] PUT /identity/v3/projects/cf2b2426392f4f8c8f3f897dec2be723/users/fe1e8d5fbf4340c480e2e21496011d28/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:58.445492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20006d2b07424974b0ef80c7fbef0ac9)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.449277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dc6e6-348c-4408-b511-9ce8e4a431db None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.449618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dc6e6-348c-4408-b511-9ce8e4a431db None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.449899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dc6e6-348c-4408-b511-9ce8e4a431db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.453270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.481101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3d3dc6e6-348c-4408-b511-9ce8e4a431db None None] MFA Rules not processed for user `fe1e8d5fbf4340c480e2e21496011d28`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:58.482333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3d3dc6e6-348c-4408-b511-9ce8e4a431db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.518579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20006d2b07424974b0ef80c7fbef0ac9', 'request_id': 'req-435eb1fd-c58c-4cd4-b932-601401d82ad7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.532036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20006d2b07424974b0ef80c7fbef0ac9', 'request_id': 'req-435eb1fd-c58c-4cd4-b932-601401d82ad7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.547694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20006d2b07424974b0ef80c7fbef0ac9', 'request_id': 'req-435eb1fd-c58c-4cd4-b932-601401d82ad7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.570297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] The token cache is being invalidate because project 20006d2b07424974b0ef80c7fbef0ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:58.570588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.571373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.572982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 946/1891] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:58 2022] DELETE /identity/v3/projects/20006d2b07424974b0ef80c7fbef0ac9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:58.576387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.578439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.590017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 946/1892] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:35:58.591647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.591940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.592752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.610478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:58.611730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.666978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435eb1fd-c58c-4cd4-b932-601401d82ad7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.672490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 947/1893] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:58.673312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.675033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.680370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.681243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.681522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.681793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] PATH_INFO: `/v3/projects/2ecf664fd07e47f18c8f549ea6c37f79` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.683221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecf664fd07e47f18c8f549ea6c37f79)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.685293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.687037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eff96a-27f8-4ae9-b0b6-2ae6a6401f44 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.693992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a1b26-55cc-4ffe-9aea-855dda496556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.695046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1b26-55cc-4ffe-9aea-855dda496556 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.695572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1b26-55cc-4ffe-9aea-855dda496556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.695940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1b26-55cc-4ffe-9aea-855dda496556 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.696843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a1b26-55cc-4ffe-9aea-855dda496556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.699536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a1b26-55cc-4ffe-9aea-855dda496556 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.736212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 948/1894] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:58 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:58.736212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.736212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.738264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.742080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecf664fd07e47f18c8f549ea6c37f79', 'request_id': 'req-34b3ee7d-bc63-42ab-b42e-345899427120'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.749815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecf664fd07e47f18c8f549ea6c37f79', 'request_id': 'req-34b3ee7d-bc63-42ab-b42e-345899427120'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.755836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:58.755984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecf664fd07e47f18c8f549ea6c37f79', 'request_id': 'req-34b3ee7d-bc63-42ab-b42e-345899427120'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.757048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.768868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] The token cache is being invalidate because project 2ecf664fd07e47f18c8f549ea6c37f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:58.769160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.769865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.771507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 947/1895] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:58 2022] DELETE /identity/v3/projects/2ecf664fd07e47f18c8f549ea6c37f79 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:58.772250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.773551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.836872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 949/1896] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:58.838532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.839132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:58.858363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3ee7d-bc63-42ab-b42e-345899427120 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.863776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.864425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.864752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.865036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.865742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.868021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.879918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e177c8f-c6a0-4ef5-b95a-8ae49e0cc1bd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.892529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.893494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.893784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.894067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] PATH_INFO: `/v3/users/3b140aaa353549f695645c2142f60c64` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.898014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 948/1897] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:58 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:58.898156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b140aaa353549f695645c2142f60c64)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.898245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.898327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.908072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823940e8-3c81-4b32-bf65-e717cdd6fb70 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.914474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.915228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.915580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.915865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.916594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:58.916901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.918490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.932173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 949/1898] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:35:58.933308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.945861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8f109-c31b-48b1-9262-66531fec2fb2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.950821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b140aaa353549f695645c2142f60c64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.951319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.952022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.952442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.952777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.953778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.955725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.960634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b140aaa353549f695645c2142f60c64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.970639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 950/1899] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:58.970639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.971684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b140aaa353549f695645c2142f60c64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.978145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28a8b-3ca4-4ae6-97c0-135f16885431 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:58.983541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:58.983931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b140aaa353549f695645c2142f60c64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.984189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:58.984479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:58.984615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b140aaa353549f695645c2142f60c64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:58.984760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:58.985489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:58.987419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:58.990415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 950/1900] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:35:58 2022] DELETE /identity/v3/users/3b140aaa353549f695645c2142f60c64 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:58.991802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:58.993487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.014976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 951/1901] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:58 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:35:59.018986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.020784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.067727 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eeeb5-b796-463b-ad38-b06c52a74a82 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.101010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f332254-200e-48ba-98a6-e81abc659b1b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.105805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.106483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.106768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.107089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.108413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.110780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.132518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 952/1902] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:59 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:59.136299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.137080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.138130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.138420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.138703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] PATH_INFO: `/v3/projects/f6a1559c9616474b884b120a8c363bc4/users/26decfc9a37e4f9a8f1eaf990b80767c/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.146650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e38bc-c520-4b64-b408-374860b21f39 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.151730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.152557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.152928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.153212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.154067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.156341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.159596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a1559c9616474b884b120a8c363bc4, user_id=26decfc9a37e4f9a8f1eaf990b80767c, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.162345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.172130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 953/1903] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:59.173520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.181834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 951/1904] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:58 2022] PUT /identity/v3/projects/f6a1559c9616474b884b120a8c363bc4/users/26decfc9a37e4f9a8f1eaf990b80767c/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:59.183237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.187760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacce4e-9c25-4543-ac2d-14ce3fe7497b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.245484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.246152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.246434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.246624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c640e-bb6d-40a5-ac49-16c73ba726e8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.246734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.247537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.249703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.252383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.253075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.253363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.253636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.254382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.256025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.263251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 954/1905] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:35:59.264807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.270741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 952/1906] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:35:59.271880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.284714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84f880-bdf9-4bb9-b40d-d119643172b4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.284956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612af3a-684a-42ec-a09e-91e0f29abcb5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.290272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.291523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.291921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.292228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] PATH_INFO: `/v3/projects/f6a1559c9616474b884b120a8c363bc4/users/26decfc9a37e4f9a8f1eaf990b80767c/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.293202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68a9c1-894c-4667-8dc5-0a9a527b5965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.293991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68a9c1-894c-4667-8dc5-0a9a527b5965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.294278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68a9c1-894c-4667-8dc5-0a9a527b5965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.294560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68a9c1-894c-4667-8dc5-0a9a527b5965 admin admin] PATH_INFO: `/v3/projects/54251ae5f1f74ba7826b0d471098d71a/users/21e70fb77054476785c3809aa6e120bd/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.297538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a1559c9616474b884b120a8c363bc4, user_id=26decfc9a37e4f9a8f1eaf990b80767c, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.300829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.321896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68a9c1-894c-4667-8dc5-0a9a527b5965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54251ae5f1f74ba7826b0d471098d71a, user_id=21e70fb77054476785c3809aa6e120bd, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.325034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb68a9c1-894c-4667-8dc5-0a9a527b5965 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.328499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 953/1907] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:59 2022] PUT /identity/v3/projects/f6a1559c9616474b884b120a8c363bc4/users/26decfc9a37e4f9a8f1eaf990b80767c/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:59.329463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.331696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.349804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 955/1908] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:35:59 2022] PUT /identity/v3/projects/54251ae5f1f74ba7826b0d471098d71a/users/21e70fb77054476785c3809aa6e120bd/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:59.350936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2fb9-c380-4af0-8169-64b97a879804 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.351225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2fb9-c380-4af0-8169-64b97a879804 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.351530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a2fb9-c380-4af0-8169-64b97a879804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.385438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-b86a2fb9-c380-4af0-8169-64b97a879804 None None] MFA Rules not processed for user `26decfc9a37e4f9a8f1eaf990b80767c`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:59.386694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b86a2fb9-c380-4af0-8169-64b97a879804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.414814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91265c9-355b-4f97-afab-45a1f343087f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.480528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 956/1909] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:59.481999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.482292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.483656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.498503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.499379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.499702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.499984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] PATH_INFO: `/v3/projects/071aa8fcb4124010abad0f81200aaeb6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.501218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] RBAC: Authorizing `identity:delete_project(project_id=071aa8fcb4124010abad0f81200aaeb6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.503531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.513406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:59.516152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.525862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 957/1910] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:59.530248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.531612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.564309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071aa8fcb4124010abad0f81200aaeb6', 'request_id': 'req-d31332f9-a4f5-4159-9021-2a618f58626d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:59.571492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071aa8fcb4124010abad0f81200aaeb6', 'request_id': 'req-d31332f9-a4f5-4159-9021-2a618f58626d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:59.577193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071aa8fcb4124010abad0f81200aaeb6', 'request_id': 'req-d31332f9-a4f5-4159-9021-2a618f58626d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:59.588352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] The token cache is being invalidate because project 071aa8fcb4124010abad0f81200aaeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:35:59.588648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:59.589304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:35:59.590924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 954/1911] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:35:59 2022] DELETE /identity/v3/projects/071aa8fcb4124010abad0f81200aaeb6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:35:59.591822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.593798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.597191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5bba1-0c9c-4191-8ea9-e6eafff73838 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.642491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494a242-9d0a-4242-b704-27c25ec0290c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.643143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494a242-9d0a-4242-b704-27c25ec0290c service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.643452 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494a242-9d0a-4242-b704-27c25ec0290c service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.643732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494a242-9d0a-4242-b704-27c25ec0290c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.645542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4494a242-9d0a-4242-b704-27c25ec0290c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.647636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31332f9-a4f5-4159-9021-2a618f58626d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.651636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534392f-916c-43fc-9d1a-f5ff11340c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.652277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534392f-916c-43fc-9d1a-f5ff11340c7b service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.652559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534392f-916c-43fc-9d1a-f5ff11340c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.652835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534392f-916c-43fc-9d1a-f5ff11340c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.655227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8534392f-916c-43fc-9d1a-f5ff11340c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.707974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494a242-9d0a-4242-b704-27c25ec0290c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.709424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494a242-9d0a-4242-b704-27c25ec0290c service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.714252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534392f-916c-43fc-9d1a-f5ff11340c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.715722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534392f-916c-43fc-9d1a-f5ff11340c7b service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.720742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 958/1912] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:59.722122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.722380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.722659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.726711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 955/1913] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:35:59.743192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:59.744641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.754754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 959/1914] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:59.762870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184cd3-3611-4030-a573-9af623c98ac7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.763419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184cd3-3611-4030-a573-9af623c98ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.763721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184cd3-3611-4030-a573-9af623c98ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.769860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.771345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.783084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2d184cd3-3611-4030-a573-9af623c98ac7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:35:59.783789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a076c4f-3f40-4f65-9afa-281aa88f8c72 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.784319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2d184cd3-3611-4030-a573-9af623c98ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.787552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.788272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.788630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.788982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.790952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:35:59.793230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 956/1915] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:35:59.797499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d184cd3-3611-4030-a573-9af623c98ac7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.806758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d184cd3-3611-4030-a573-9af623c98ac7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.813587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.814461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.814750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.815375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.815878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:35:59.816317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.817945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.831660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 957/1916] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:35:59.835196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.850486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf354e-0883-4464-a552-2b955d580cd7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:35:59.855505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:35:59.856306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:35:59.856732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:35:59.857124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:35:59.857948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.860016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.865045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:35:59.866838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:35:59.879348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 960/1917] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:35:59.895764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 958/1918] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:35:59 2022] POST /identity/v3/projects => generated 361 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:35:59.901005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:35:59.918701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b6a8a-8e5c-426b-8158-9e9fa131447d service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.023852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.024538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.025380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.025380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.026057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.028051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.065256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.077314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 961/1919] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:35:59 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:00.080125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c047-5032-4c21-bf6c-2c9106f24889 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.086706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.087545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.088356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.088356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.088940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.090623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.103713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 959/1920] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:00.108700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.128869 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6a2f-9c00-45a2-a5d2-c25155af47ed admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.134520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f61095-0714-47ff-9cfd-b4bdf134bebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.135197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61095-0714-47ff-9cfd-b4bdf134bebd admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.135543 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61095-0714-47ff-9cfd-b4bdf134bebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.135853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f61095-0714-47ff-9cfd-b4bdf134bebd admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.136546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f61095-0714-47ff-9cfd-b4bdf134bebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.138328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f61095-0714-47ff-9cfd-b4bdf134bebd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.151076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 962/1921] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:00.153932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.165387 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9d83-d9bc-453a-ba3a-7319eb23c925 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.173794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.175615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.176963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.177423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] PATH_INFO: `/v3/projects/4a6f045116844c9b932ac88f7e39f62c/users/03fed3e755544d608f52e0af7d44fefa/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.199433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6f045116844c9b932ac88f7e39f62c, user_id=03fed3e755544d608f52e0af7d44fefa, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.203915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.232220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 960/1922] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:00 2022] PUT /identity/v3/projects/4a6f045116844c9b932ac88f7e39f62c/users/03fed3e755544d608f52e0af7d44fefa/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:00.234129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33b65-896a-4952-95cf-44b4fd6f542c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.234430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33b65-896a-4952-95cf-44b4fd6f542c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.234720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33b65-896a-4952-95cf-44b4fd6f542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.276481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f5b33b65-896a-4952-95cf-44b4fd6f542c None None] MFA Rules not processed for user `03fed3e755544d608f52e0af7d44fefa`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:00.278481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f5b33b65-896a-4952-95cf-44b4fd6f542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:00.386994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 963/1923] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:00.424018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.426120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:00.494907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c7f77-deae-415d-b96c-c48243ccc13f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.500217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.500903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.501191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.501616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.511165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.512503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.524940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 961/1924] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:00.529948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.530251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.530535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.548720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.607301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] MFA Rules not processed for user `21e70fb77054476785c3809aa6e120bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:00.611911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:00.655574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c4f6-ed8b-48a3-b73f-ebbc77ab9d08 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.662487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.671147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.671704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.672742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] PATH_INFO: `/v3/users/03fed3e755544d608f52e0af7d44fefa` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.681777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fed3e755544d608f52e0af7d44fefa)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.684190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.727706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 964/1925] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:00.732308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.735211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:00.770065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82c9a1-6e74-4bd9-8310-1078fa1ed18d None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.775276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.776074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.776431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.776785 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.777516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fed3e755544d608f52e0af7d44fefa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:00.777628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.780183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.790828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fed3e755544d608f52e0af7d44fefa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:00.800636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fed3e755544d608f52e0af7d44fefa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:00.824769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fed3e755544d608f52e0af7d44fefa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:00.825606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-046dd95c-d255-44b6-8d5c-8d0836445dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fed3e755544d608f52e0af7d44fefa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:00.834089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 962/1926] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:00 2022] DELETE /identity/v3/users/03fed3e755544d608f52e0af7d44fefa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:00.838534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.838942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 965/1927] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:00 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:00.839353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.839691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.845383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.847159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:00.859164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:00.860449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:00.924578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921e64f-e3a5-47f7-84a0-6ded7b98a967 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.929407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.930081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.930367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.930663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.931375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.933655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.933791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 963/1928] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:00.943519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.945036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:00.959978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 966/1929] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:00 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:36:00.963758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:00.973999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3054a8-3f96-41f2-b2bf-e6edadbbf9a5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:00.979572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:00.980228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:00.980533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:00.980813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:00.981548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:00.983252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:00.997490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 967/1930] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:01.002134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:01.012834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb32e1-20a1-4366-8ee4-caa636fec187 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:01.019296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:01.020347 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.020629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.020909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] PATH_INFO: `/v3/projects/7f435b94e34d46e6bc1ee2731a6574d0/users/04dfbe48c39248a5bf1611e120fe6ce5/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.028992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6cd51-fcb2-4c2c-9c92-1705b3f3760a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:01.033841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:01.034504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.034791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.035074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.044853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:01.045567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f435b94e34d46e6bc1ee2731a6574d0, user_id=04dfbe48c39248a5bf1611e120fe6ce5, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:01.046364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:01.048286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:01.057652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 964/1931] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:01.064043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 968/1932] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:01 2022] PUT /identity/v3/projects/7f435b94e34d46e6bc1ee2731a6574d0/users/04dfbe48c39248a5bf1611e120fe6ce5/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:01.067946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:01.080016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ba557-65a0-4f77-ba86-05c2a5b423df service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:01.137495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:01.138175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.138490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.139267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.140216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:01.141821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:01.156052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 965/1933] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:01.157290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:01.168242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8a031-7c83-4507-bbbf-4db2d5b580d1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:01.173150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b8c57-d343-4d1d-8098-b5054734f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:01.174037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8c57-d343-4d1d-8098-b5054734f800 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.174471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8c57-d343-4d1d-8098-b5054734f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.174755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b8c57-d343-4d1d-8098-b5054734f800 admin admin] PATH_INFO: `/v3/projects/7f435b94e34d46e6bc1ee2731a6574d0/users/04dfbe48c39248a5bf1611e120fe6ce5/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.176771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b8c57-d343-4d1d-8098-b5054734f800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f435b94e34d46e6bc1ee2731a6574d0, user_id=04dfbe48c39248a5bf1611e120fe6ce5, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:01.179481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b8c57-d343-4d1d-8098-b5054734f800 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:01.190994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 969/1934] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:01 2022] PUT /identity/v3/projects/7f435b94e34d46e6bc1ee2731a6574d0/users/04dfbe48c39248a5bf1611e120fe6ce5/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:01.438568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:01.440903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:01.461246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505a24-3f7c-453b-8cd5-232986a75309 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:01.551765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:01.552907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.553297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.553681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] PATH_INFO: `/v3/projects/4a6f045116844c9b932ac88f7e39f62c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.555204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6f045116844c9b932ac88f7e39f62c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:01.557809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:01.631198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6f045116844c9b932ac88f7e39f62c', 'request_id': 'req-6ea21570-2817-4248-ada6-f84c93787f5c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:01.653551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6f045116844c9b932ac88f7e39f62c', 'request_id': 'req-6ea21570-2817-4248-ada6-f84c93787f5c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:01.681554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6f045116844c9b932ac88f7e39f62c', 'request_id': 'req-6ea21570-2817-4248-ada6-f84c93787f5c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:01.705849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] The token cache is being invalidate because project 4a6f045116844c9b932ac88f7e39f62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:01.706470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:01.707481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ea21570-2817-4248-ada6-f84c93787f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:01.709206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 966/1935] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:01 2022] DELETE /identity/v3/projects/4a6f045116844c9b932ac88f7e39f62c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:01.718686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340e978-1c9c-44a8-af68-569e0b202229 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.719805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340e978-1c9c-44a8-af68-569e0b202229 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.720391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340e978-1c9c-44a8-af68-569e0b202229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.751734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0340e978-1c9c-44a8-af68-569e0b202229 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:01.753581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0340e978-1c9c-44a8-af68-569e0b202229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:01.900737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 970/1936] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:01.901200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edab62a-f203-48d5-a2e5-f3454e56d3d5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.901529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edab62a-f203-48d5-a2e5-f3454e56d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.901851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edab62a-f203-48d5-a2e5-f3454e56d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.939429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4edab62a-f203-48d5-a2e5-f3454e56d3d5 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:01.943541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4edab62a-f203-48d5-a2e5-f3454e56d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:01.967354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 967/1937] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:01.971266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340e978-1c9c-44a8-af68-569e0b202229 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:01.991383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340e978-1c9c-44a8-af68-569e0b202229 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:01.996837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:01.997507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:01.997789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:01.998166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:01.998918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:01.999221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.000868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.016668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 971/1938] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:36:02.020651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edab62a-f203-48d5-a2e5-f3454e56d3d5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:02.042086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edab62a-f203-48d5-a2e5-f3454e56d3d5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:02.059333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8799e6-5e7a-4526-967c-2f5d9f37cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:02.061266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8799e6-5e7a-4526-967c-2f5d9f37cd38 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.061581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8799e6-5e7a-4526-967c-2f5d9f37cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.065109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8799e6-5e7a-4526-967c-2f5d9f37cd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.066005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8799e6-5e7a-4526-967c-2f5d9f37cd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.069184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8799e6-5e7a-4526-967c-2f5d9f37cd38 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.155251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 968/1939] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:02 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:36:02.156561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:02.178304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115dd81-40dd-4aef-b895-bf0d17115faf admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:02.317483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:02.318242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.318837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.319177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.320014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.322054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.352631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062907ec-ef57-46ba-9555-75840033f921 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.352924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062907ec-ef57-46ba-9555-75840033f921 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.353262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062907ec-ef57-46ba-9555-75840033f921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.389209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 972/1940] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:02 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:02.390179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:02.415812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7807d5d-793c-4200-8e5f-62d02d30ad12 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:02.420510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-062907ec-ef57-46ba-9555-75840033f921 None None] MFA Rules not processed for user `04dfbe48c39248a5bf1611e120fe6ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:02.422133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-062907ec-ef57-46ba-9555-75840033f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:02.428954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:02.429718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.431285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.431599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.432953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.454635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.485649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 973/1941] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:02.488770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:02.552699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3d161-4d59-4ee6-a310-3023dd46fde0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:02.574239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b0b47-7db5-4108-9561-5bf938f7ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:02.577314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b0b47-7db5-4108-9561-5bf938f7ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.577565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b0b47-7db5-4108-9561-5bf938f7ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.579262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b0b47-7db5-4108-9561-5bf938f7ccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.580179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b0b47-7db5-4108-9561-5bf938f7ccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.581813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b0b47-7db5-4108-9561-5bf938f7ccd1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.604016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 969/1942] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:02.613103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 974/1943] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:02.617931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062907ec-ef57-46ba-9555-75840033f921 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:02.637126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062907ec-ef57-46ba-9555-75840033f921 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:02.648459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:02.649539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.650360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.650649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] PATH_INFO: `/v3/projects/b81ed2187e4b4bb480ac9927221e90fc/users/363a5d18ceb5439497fe406469397fea/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.678286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81ed2187e4b4bb480ac9927221e90fc, user_id=363a5d18ceb5439497fe406469397fea, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.681149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.698071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 970/1944] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:02 2022] PUT /identity/v3/projects/b81ed2187e4b4bb480ac9927221e90fc/users/363a5d18ceb5439497fe406469397fea/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:02.703942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.704358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.704720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.706004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:02.707817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:02.738685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:02.740025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:02.792830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3077f-cb9e-4eb7-876d-954fab54a473 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:02.799151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:02.799906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.800243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.800932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.803104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:02.840579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 975/1945] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:02.851812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:02.854138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:02.885196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.886639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.897706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 971/1946] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:02.919355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98a689-63ed-4318-ae25-3003bb498473 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:02.923256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a37db-3e58-4a0c-9627-2ccb63b208fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:02.923999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a37db-3e58-4a0c-9627-2ccb63b208fa service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:02.924399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a37db-3e58-4a0c-9627-2ccb63b208fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:02.924734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a37db-3e58-4a0c-9627-2ccb63b208fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:02.934321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a37db-3e58-4a0c-9627-2ccb63b208fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:02.936589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a37db-3e58-4a0c-9627-2ccb63b208fa service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:02.950440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 976/1947] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:04.021307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:04.022835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:04.038558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa71e-a60f-49f7-8983-1640f3dbbe2b service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:04.047129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:04.050766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:04.053023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:04.053479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] PATH_INFO: `/v3/users/fe1e8d5fbf4340c480e2e21496011d28` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:04.056283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1e8d5fbf4340c480e2e21496011d28)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:04.058565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:04.120250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1e8d5fbf4340c480e2e21496011d28'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:04.130721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1e8d5fbf4340c480e2e21496011d28'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:04.141486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1e8d5fbf4340c480e2e21496011d28'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:04.158856 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1e8d5fbf4340c480e2e21496011d28'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:04.160006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1e8d5fbf4340c480e2e21496011d28'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:04.168284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 972/1948] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:04 2022] DELETE /identity/v3/users/fe1e8d5fbf4340c480e2e21496011d28 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:04.173279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:04.174224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:04.174510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:04.204914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:04.207847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:04.335621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 977/1949] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:04.346350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:04.347882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:04.375061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:04.377136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:04.485309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede6dc4-445f-4c55-bef5-e3207d141d29 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:04.490166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:04.490988 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:04.491367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:04.491773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:04.495001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:04.530055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee8941-6ae3-4a2e-9ac4-146e379b1069 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:04.551262 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:04.551969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:04.552258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:04.553030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:04.570854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:04.572325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:04.588361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 973/1950] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:04.628847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:04.630852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:04.644229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 978/1951] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:05.360636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:05.362150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:05.392225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a97593-3e80-4c82-a5e4-a760615d0679 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:05.402075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:05.403034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:05.403229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:05.403720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] PATH_INFO: `/v3/users/cb5d234a3b9e46a5bdf6fd9b66c6267d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:05.405771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5d234a3b9e46a5bdf6fd9b66c6267d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:05.409521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:05.458616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:05.460222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:05.481901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b144a9-cf22-4658-9cb0-a98ff89c8129 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:05.483737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5d234a3b9e46a5bdf6fd9b66c6267d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.497475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5d234a3b9e46a5bdf6fd9b66c6267d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.509762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5d234a3b9e46a5bdf6fd9b66c6267d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.513527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:05.515134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:05.515435 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:05.515962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] PATH_INFO: `/v3/projects/cf2b2426392f4f8c8f3f897dec2be723` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:05.517529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2b2426392f4f8c8f3f897dec2be723)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:05.522155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:05.548547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5d234a3b9e46a5bdf6fd9b66c6267d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.552784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3339d59-bbac-4f8b-81c1-d6a23655e9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5d234a3b9e46a5bdf6fd9b66c6267d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.564689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 974/1952] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:05 2022] DELETE /identity/v3/users/cb5d234a3b9e46a5bdf6fd9b66c6267d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:05.566839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:05.566839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:05.567031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:05.588373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:05.589604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:05.601002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2b2426392f4f8c8f3f897dec2be723', 'request_id': 'req-cf35edff-92e5-42a5-a0a2-571d4cc87b82'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.608819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2b2426392f4f8c8f3f897dec2be723', 'request_id': 'req-cf35edff-92e5-42a5-a0a2-571d4cc87b82'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.615566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2b2426392f4f8c8f3f897dec2be723', 'request_id': 'req-cf35edff-92e5-42a5-a0a2-571d4cc87b82'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.656364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] The token cache is being invalidate because project cf2b2426392f4f8c8f3f897dec2be723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:05.656658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.657540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.659560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 979/1953] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:05 2022] DELETE /identity/v3/projects/cf2b2426392f4f8c8f3f897dec2be723 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:05.663369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:05.665199 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:05.751799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 975/1954] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:05.756842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35edff-92e5-42a5-a0a2-571d4cc87b82 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:05.761837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:05.763248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:05.763625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:05.764663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:05.765147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] PATH_INFO: `/v3/users/26decfc9a37e4f9a8f1eaf990b80767c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:05.766727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26decfc9a37e4f9a8f1eaf990b80767c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:05.769215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:05.776054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:05.847488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26decfc9a37e4f9a8f1eaf990b80767c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.855072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26decfc9a37e4f9a8f1eaf990b80767c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.879377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad41358-bae2-4196-ab48-8c6db1d9f92e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:05.889400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:05.890668 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:05.890960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:05.891242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:05.897186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26decfc9a37e4f9a8f1eaf990b80767c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.901532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:05.903145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:05.908721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26decfc9a37e4f9a8f1eaf990b80767c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.909456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26decfc9a37e4f9a8f1eaf990b80767c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:05.919880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 976/1955] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:05.920554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 980/1956] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:05 2022] DELETE /identity/v3/users/26decfc9a37e4f9a8f1eaf990b80767c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:06.411630 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:06.441722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4001-9aad-49f1-b117-9dd4781ffbf2 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:06.443999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:06.445564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:06.561007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe8ff8-57a3-4cbf-8dba-930fb16d2c72 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:06.581304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:06.582310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:06.582665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:06.583022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] PATH_INFO: `/v3/projects/38080e0b28114c1ba467265ac6b1aa7a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:06.584484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38080e0b28114c1ba467265ac6b1aa7a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:06.586747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:06.609092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:06.609968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:06.610297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:06.610519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] PATH_INFO: `/v3/projects/f6a1559c9616474b884b120a8c363bc4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:06.613719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a1559c9616474b884b120a8c363bc4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:06.615768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:06.651502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38080e0b28114c1ba467265ac6b1aa7a', 'request_id': 'req-33b218eb-ed5f-4c9c-ae19-8092114001a2'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.669357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38080e0b28114c1ba467265ac6b1aa7a', 'request_id': 'req-33b218eb-ed5f-4c9c-ae19-8092114001a2'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.677902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a1559c9616474b884b120a8c363bc4', 'request_id': 'req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.678338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38080e0b28114c1ba467265ac6b1aa7a', 'request_id': 'req-33b218eb-ed5f-4c9c-ae19-8092114001a2'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.690026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a1559c9616474b884b120a8c363bc4', 'request_id': 'req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.698240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a1559c9616474b884b120a8c363bc4', 'request_id': 'req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.701896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] The token cache is being invalidate because project 38080e0b28114c1ba467265ac6b1aa7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:06.702290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.703598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.705252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 981/1957] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:06 2022] DELETE /identity/v3/projects/38080e0b28114c1ba467265ac6b1aa7a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:06.712943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:06.715125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:06.715380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] The token cache is being invalidate because project f6a1559c9616474b884b120a8c363bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:06.715987 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.718741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49a8d3d2-39b5-40d3-a99c-c2f9e40fbe60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:06.721900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 977/1958] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:06 2022] DELETE /identity/v3/projects/f6a1559c9616474b884b120a8c363bc4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:06.729797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc95be-62c7-4142-bfe8-00d8cfb486a0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:06.730620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc95be-62c7-4142-bfe8-00d8cfb486a0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:06.731178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc95be-62c7-4142-bfe8-00d8cfb486a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:06.760343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-dacc95be-62c7-4142-bfe8-00d8cfb486a0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:06.761978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dacc95be-62c7-4142-bfe8-00d8cfb486a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:06.837333 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b218eb-ed5f-4c9c-ae19-8092114001a2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:06.892287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 978/1959] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:06.900369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec480f3-3821-40c5-9213-8c0ed78abc26 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:06.900944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec480f3-3821-40c5-9213-8c0ed78abc26 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:06.902182 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec480f3-3821-40c5-9213-8c0ed78abc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:06.931761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:06.933174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:06.933471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:06.936307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] PATH_INFO: `/v3/users/c40552628e984be4af073e75d856d44e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:06.937658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40552628e984be4af073e75d856d44e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:06.940267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:06.940460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-dec480f3-3821-40c5-9213-8c0ed78abc26 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:06.941609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dec480f3-3821-40c5-9213-8c0ed78abc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:06.963714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 979/1960] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:06.969281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec480f3-3821-40c5-9213-8c0ed78abc26 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:06.979347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec480f3-3821-40c5-9213-8c0ed78abc26 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:06.987857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:06.988523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:06.989137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:06.989137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:06.990173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:06.990407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:06.993221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.012456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 980/1961] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:36:07.012627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40552628e984be4af073e75d856d44e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.013653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.025538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0dd50-9307-4af9-afec-b47814c275b2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.028406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40552628e984be4af073e75d856d44e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.031335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.032109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.032520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.032706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.033435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.035542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.061890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40552628e984be4af073e75d856d44e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.074017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40552628e984be4af073e75d856d44e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.074738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40552628e984be4af073e75d856d44e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.082704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 982/1962] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:06 2022] DELETE /identity/v3/users/c40552628e984be4af073e75d856d44e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:07.089141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 981/1963] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:07 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:07.093714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.095744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:07.194052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad5726-185a-4d2b-bc30-dadfc8c8c6d5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.199827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.200556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.200844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.201177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.201906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.203951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.231094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 983/1964] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:07 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:07.236712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.347527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb957ddc-fd3b-449a-b13f-9c84cdbfca3c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.354456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.355447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.356134 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.356134 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.356924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.361637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.386005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 982/1965] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:07.387244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.398357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e0907-de72-4e9e-9e40-5b0fa94b3f18 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.403857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.405312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.405591 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.405874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.406618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.408515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.419417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 984/1966] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:07.423892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.432471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.434279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:07.438221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ba145-9023-44ce-9767-bfdb705a6e3e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.452966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4505449-48b7-4277-89e9-0eecf6c25408 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.455236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ad42e-aff9-416f-8a12-3bb01db19a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.456394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad42e-aff9-416f-8a12-3bb01db19a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.456678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad42e-aff9-416f-8a12-3bb01db19a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.456958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad42e-aff9-416f-8a12-3bb01db19a57 admin admin] PATH_INFO: `/v3/projects/48ed661c0aaf4a56be568cd4f43ae446/users/38b9baefe88c49418d5fe93ed8ba36f0/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.469799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.470783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.471070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.473143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] PATH_INFO: `/v3/projects/a9bb72f6394844cb8a1dc09ccf7091e7` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.474602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ad42e-aff9-416f-8a12-3bb01db19a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ed661c0aaf4a56be568cd4f43ae446, user_id=38b9baefe88c49418d5fe93ed8ba36f0, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.475136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bb72f6394844cb8a1dc09ccf7091e7)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.477269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.477538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ad42e-aff9-416f-8a12-3bb01db19a57 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.495080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 983/1967] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:07 2022] PUT /identity/v3/projects/48ed661c0aaf4a56be568cd4f43ae446/users/38b9baefe88c49418d5fe93ed8ba36f0/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:07.505485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.506154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.506510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.528845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bb72f6394844cb8a1dc09ccf7091e7', 'request_id': 'req-4602c846-8417-4b70-a836-7c852f55244b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.536854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bb72f6394844cb8a1dc09ccf7091e7', 'request_id': 'req-4602c846-8417-4b70-a836-7c852f55244b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.537523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] MFA Rules not processed for user `38b9baefe88c49418d5fe93ed8ba36f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:07.538929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:07.542730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bb72f6394844cb8a1dc09ccf7091e7', 'request_id': 'req-4602c846-8417-4b70-a836-7c852f55244b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.562453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] The token cache is being invalidate because project a9bb72f6394844cb8a1dc09ccf7091e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:07.563033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.565924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4602c846-8417-4b70-a836-7c852f55244b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:07.572058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 985/1968] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:07 2022] DELETE /identity/v3/projects/a9bb72f6394844cb8a1dc09ccf7091e7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:07.577179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459cbc6-3b4b-47dc-8bcf-f06dff415631 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.577472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459cbc6-3b4b-47dc-8bcf-f06dff415631 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.577756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459cbc6-3b4b-47dc-8bcf-f06dff415631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.612960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-8459cbc6-3b4b-47dc-8bcf-f06dff415631 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:07.614182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8459cbc6-3b4b-47dc-8bcf-f06dff415631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:07.693318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 984/1969] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:07.702651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.704650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:07.729373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 986/1970] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:07.737637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109944-0b6c-47f6-90cf-90fea583c69e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.737974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109944-0b6c-47f6-90cf-90fea583c69e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.739364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109944-0b6c-47f6-90cf-90fea583c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.781560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f3109944-0b6c-47f6-90cf-90fea583c69e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:07.782782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f3109944-0b6c-47f6-90cf-90fea583c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:07.791592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 987/1971] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:07.795845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3109944-0b6c-47f6-90cf-90fea583c69e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.809643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3109944-0b6c-47f6-90cf-90fea583c69e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.816739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.817411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.818116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.818116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.818714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:07.819026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.820748 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.834041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 988/1972] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:36:07.838691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.850589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4ec8-9ee2-437a-925a-8eae83b0d319 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.854205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0ae55-a69f-462f-83e2-7535eff2b668 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:07.862807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.864246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.865733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.866212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.866974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:07.868446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:07.868868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:07.869280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:07.870163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.872140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.883718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:07.884817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:07.912487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 985/1973] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:07.923579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.927124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:07.937684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 989/1974] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:07 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:07.938686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:07.981019 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24fc-336a-4ca4-9a3b-60e26bcda62f service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:08.060730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6ef32-7fd2-4191-9b92-8e6a605faeae admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:08.080346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:08.081048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.082661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.083882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.084642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:08.089841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:08.098717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:08.100169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.111800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.112136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] PATH_INFO: `/v3/users/38b9baefe88c49418d5fe93ed8ba36f0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.115445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b9baefe88c49418d5fe93ed8ba36f0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:08.118833 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:08.137004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 990/1975] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:07 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:08.141045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:08.156623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd654f-68d9-473a-a33c-cd58b5513353 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:08.176215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:08.179665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.180903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.181528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.188527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:08.192986 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:08.206234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b9baefe88c49418d5fe93ed8ba36f0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:08.220167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 991/1976] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:08.223518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b9baefe88c49418d5fe93ed8ba36f0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:08.228883 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:08.239008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b9baefe88c49418d5fe93ed8ba36f0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:08.253666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1160f-c118-490d-a7e6-060e5475eee5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:08.269734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:08.271012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b9baefe88c49418d5fe93ed8ba36f0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:08.271782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.272433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.273134 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-79bda91e-4d5c-49eb-a33e-5f4f844745e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b9baefe88c49418d5fe93ed8ba36f0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:08.273555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.274512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:08.282623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:08.288164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 986/1977] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:07 2022] DELETE /identity/v3/users/38b9baefe88c49418d5fe93ed8ba36f0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:08.292337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.296456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.296862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.310696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 992/1978] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:08.314304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:08.318649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:08.333322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:08.334817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:08.344435 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675236c-6f8c-4b97-aa51-33f366bb33bb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:08.421012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093127f6-15fa-46ad-b1ac-2acca165e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:08.422497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093127f6-15fa-46ad-b1ac-2acca165e59e admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.422884 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093127f6-15fa-46ad-b1ac-2acca165e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.423309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093127f6-15fa-46ad-b1ac-2acca165e59e admin admin] PATH_INFO: `/v3/projects/60f6faa206004295afc3a30c99aeb01f/users/305dd5766a5f49be9fe7752b45010f5a/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.456738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093127f6-15fa-46ad-b1ac-2acca165e59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f6faa206004295afc3a30c99aeb01f, user_id=305dd5766a5f49be9fe7752b45010f5a, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:08.460055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 987/1979] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:08.462639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093127f6-15fa-46ad-b1ac-2acca165e59e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:08.469784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:08.471834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:08.494330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 993/1980] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:08 2022] PUT /identity/v3/projects/60f6faa206004295afc3a30c99aeb01f/users/305dd5766a5f49be9fe7752b45010f5a/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:08.506241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51d4e-c7e1-4d22-8d78-bee4e612a405 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.506707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51d4e-c7e1-4d22-8d78-bee4e612a405 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.507204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51d4e-c7e1-4d22-8d78-bee4e612a405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.571600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1ca51d4e-c7e1-4d22-8d78-bee4e612a405 None None] MFA Rules not processed for user `305dd5766a5f49be9fe7752b45010f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:08.574113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1ca51d4e-c7e1-4d22-8d78-bee4e612a405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:08.605904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5e17-7cb6-4a94-ae17-94a97f7658bf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:08.676405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 994/1981] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:08.678568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca51d4e-c7e1-4d22-8d78-bee4e612a405 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:08.680783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:08.681699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.682135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.682560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.787497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:08.789120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:08.803031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 988/1982] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:08.821546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca51d4e-c7e1-4d22-8d78-bee4e612a405 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:08.837334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:08.838448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:08.838889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:08.839308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:08.840198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:08.842353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:08.899226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 995/1983] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:08 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:08.904886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:08.922496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119e03c-7695-4bd4-9b8c-396bf13cfb7f service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:09.093467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:09.093467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.093467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.093467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.094037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:09.096126 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:09.145320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 989/1984] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:08 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:09.146555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:09.167709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148333a4-49aa-4c88-a597-78637bc26df6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:09.175110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:09.175641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.175981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.176269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.177384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:09.178742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:09.193982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 996/1985] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:09.199129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:09.215181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652272b-5628-458d-91af-83531386ed9a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:09.224669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:09.228315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.228315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.228315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] PATH_INFO: `/v3/projects/720b0f83dc1149e4a00cfbb8e8d98c42/users/41274e034bfd48e6a1e22aa73ddf89d5/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.266683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720b0f83dc1149e4a00cfbb8e8d98c42, user_id=41274e034bfd48e6a1e22aa73ddf89d5, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:09.270874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:09.298723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 990/1986] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:09 2022] PUT /identity/v3/projects/720b0f83dc1149e4a00cfbb8e8d98c42/users/41274e034bfd48e6a1e22aa73ddf89d5/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:09.299977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:09.315175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf4c5-1676-4de5-b8e6-6bceb951e86c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:09.450739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:09.452278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.454465 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.455147 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.460619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:09.462664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:09.473665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:09.476374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:09.537632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6002d-5435-4775-902b-2d8c071f3c64 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:09.542326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 997/1987] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:09.554100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:09.567883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:09.569223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.569520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.572359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] PATH_INFO: `/v3/projects/48ed661c0aaf4a56be568cd4f43ae446` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.582822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ed661c0aaf4a56be568cd4f43ae446)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:09.589621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:09.597667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4b4f-701e-45c1-b804-9232532b999c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:09.605298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00242e2f-1e37-4d95-a6f8-fe34619ff7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:09.606210 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00242e2f-1e37-4d95-a6f8-fe34619ff7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.606495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00242e2f-1e37-4d95-a6f8-fe34619ff7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.606774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00242e2f-1e37-4d95-a6f8-fe34619ff7e9 admin admin] PATH_INFO: `/v3/projects/720b0f83dc1149e4a00cfbb8e8d98c42/users/41274e034bfd48e6a1e22aa73ddf89d5/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.609137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00242e2f-1e37-4d95-a6f8-fe34619ff7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720b0f83dc1149e4a00cfbb8e8d98c42, user_id=41274e034bfd48e6a1e22aa73ddf89d5, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:09.612052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00242e2f-1e37-4d95-a6f8-fe34619ff7e9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:09.637933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 998/1988] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:09 2022] PUT /identity/v3/projects/720b0f83dc1149e4a00cfbb8e8d98c42/users/41274e034bfd48e6a1e22aa73ddf89d5/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:09.645474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.647372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.647897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.694912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] MFA Rules not processed for user `41274e034bfd48e6a1e22aa73ddf89d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:09.696694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:09.721543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ed661c0aaf4a56be568cd4f43ae446', 'request_id': 'req-f434a0e9-449e-47cd-aa3f-f073ba0a0249'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:09.738600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ed661c0aaf4a56be568cd4f43ae446', 'request_id': 'req-f434a0e9-449e-47cd-aa3f-f073ba0a0249'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:09.745639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ed661c0aaf4a56be568cd4f43ae446', 'request_id': 'req-f434a0e9-449e-47cd-aa3f-f073ba0a0249'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:09.766186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] The token cache is being invalidate because project 48ed661c0aaf4a56be568cd4f43ae446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:09.766488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:09.769804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f434a0e9-449e-47cd-aa3f-f073ba0a0249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:09.772279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 991/1989] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:09 2022] DELETE /identity/v3/projects/48ed661c0aaf4a56be568cd4f43ae446 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:09.778386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f246-e455-425c-88da-c17999756418 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.778682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f246-e455-425c-88da-c17999756418 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.778989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f246-e455-425c-88da-c17999756418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.811163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3c15f246-e455-425c-88da-c17999756418 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:09.812509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3c15f246-e455-425c-88da-c17999756418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:09.857252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 999/1990] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:09.869708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:09.871167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:09.930622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 992/1991] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:09.932253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3767-9586-4081-a5ba-b6bd61188281 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.932603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3767-9586-4081-a5ba-b6bd61188281 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.932949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3767-9586-4081-a5ba-b6bd61188281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:09.970432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55850c2-1dcc-4186-bd27-348fc6e50578 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:09.973761 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-190f3767-9586-4081-a5ba-b6bd61188281 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:09.976815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-190f3767-9586-4081-a5ba-b6bd61188281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:09.978790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:09.985175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:09.986109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:09.986561 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.002859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.004769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 993/1992] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:10.006034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.009551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3767-9586-4081-a5ba-b6bd61188281 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.025448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3767-9586-4081-a5ba-b6bd61188281 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:10.031674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:10.038954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1000/1993] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:10.042198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.042492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.045496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.046314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:10.046633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.050800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.091515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 994/1994] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:36:10.097032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.114802 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193bcbe-3031-404c-abaf-19f1f291a134 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:10.128245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:10.128932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.130099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.130412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.131174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.133218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.215886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1001/1995] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:10 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:10.219872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.232781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef77e9-71af-48d5-a39c-601b6613483d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:10.364828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:10.365539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.365830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.366116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.366889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.376055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.426311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 995/1996] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:10 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:10.431317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.484963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711e65-ead9-46a1-9a36-e08a887f16a8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:10.503951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:10.504644 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.504926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.505206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.506005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.509006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.534957 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1002/1997] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:10.535710 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.552381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c8766-7be1-4e5f-b9c4-b984ace2dca7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:10.559805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:10.561038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.561513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.561895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.563306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.565617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.584343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.597488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922fe0-f207-4e64-a905-f5b362941df5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:10.598393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 996/1998] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:10.608815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa5653-b9f6-4cff-ba1e-c7f9c90b1036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:10.609967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5653-b9f6-4cff-ba1e-c7f9c90b1036 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.610401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5653-b9f6-4cff-ba1e-c7f9c90b1036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.610627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa5653-b9f6-4cff-ba1e-c7f9c90b1036 admin admin] PATH_INFO: `/v3/projects/f1b2fe1334bf4f11b99e038385c275dd/users/3fb2ca1b6bfa45199d63cdf74f480344/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.637144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.640290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:10.656891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39e96-f0d4-4c18-ad51-211b43791d92 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:10.665036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:10.666109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.666219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.666461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] PATH_INFO: `/v3/users/305dd5766a5f49be9fe7752b45010f5a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.671102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] RBAC: Authorizing `identity:delete_user(user_id=305dd5766a5f49be9fe7752b45010f5a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.675512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.681094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa5653-b9f6-4cff-ba1e-c7f9c90b1036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b2fe1334bf4f11b99e038385c275dd, user_id=3fb2ca1b6bfa45199d63cdf74f480344, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:10.684575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa5653-b9f6-4cff-ba1e-c7f9c90b1036 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:10.713172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1003/1999] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:10 2022] PUT /identity/v3/projects/f1b2fe1334bf4f11b99e038385c275dd/users/3fb2ca1b6bfa45199d63cdf74f480344/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:10.725418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.725705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.726965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.768668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] MFA Rules not processed for user `3fb2ca1b6bfa45199d63cdf74f480344`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:10.770932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:10.784598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305dd5766a5f49be9fe7752b45010f5a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:10.795194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305dd5766a5f49be9fe7752b45010f5a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:10.807978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305dd5766a5f49be9fe7752b45010f5a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:10.829237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305dd5766a5f49be9fe7752b45010f5a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:10.830279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e3a71c39-2911-4050-8d87-b8afa038107f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305dd5766a5f49be9fe7752b45010f5a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:10.838066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 997/2000] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:10 2022] DELETE /identity/v3/users/305dd5766a5f49be9fe7752b45010f5a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:10.845601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:10.848039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:10.848435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:10.876719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:10.878901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:10.903355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1004/2001] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:10.938907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:10.940724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:11.012490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 998/2002] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:11.029040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:11.031917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:11.067294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e42eac-638f-469a-8d25-60dd9f8ce2f9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:11.141929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:11.142896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:11.143729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:11.144223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:11.153948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26af81-6f15-43a7-abcf-3c16152c00a0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:11.163921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc3e22-2137-4f34-85e9-2c3821adcb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:11.168653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc3e22-2137-4f34-85e9-2c3821adcb07 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:11.170415 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc3e22-2137-4f34-85e9-2c3821adcb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:11.170805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc3e22-2137-4f34-85e9-2c3821adcb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:11.192389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc3e22-2137-4f34-85e9-2c3821adcb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:11.194844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc3e22-2137-4f34-85e9-2c3821adcb07 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:11.228943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 999/2003] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:11.240471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:11.241935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:11.264978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1005/2004] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:11.875144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:11.875683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:11.875774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:11.929531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] MFA Rules not processed for user `363a5d18ceb5439497fe406469397fea`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:11.930801 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:12.026824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.028339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:12.045967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bffcc-1c2a-4b6e-b555-6efdd1dce806 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.051905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.053635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.053921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.054206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] PATH_INFO: `/v3/projects/60f6faa206004295afc3a30c99aeb01f` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.056368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f6faa206004295afc3a30c99aeb01f)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.059048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.088447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1000/2005] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:12.092695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.094210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:12.112599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a5793-8f20-44f0-839e-4a8f69bf0b4a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.120616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.121454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.121840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.122224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.123752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.129123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.173902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1001/2006] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:12 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:36:12.179045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.188844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f6faa206004295afc3a30c99aeb01f', 'request_id': 'req-97ce0604-6fef-4d4c-9a4d-b4888a640188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.199891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f6faa206004295afc3a30c99aeb01f', 'request_id': 'req-97ce0604-6fef-4d4c-9a4d-b4888a640188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.207645 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f6faa206004295afc3a30c99aeb01f', 'request_id': 'req-97ce0604-6fef-4d4c-9a4d-b4888a640188'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.239816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] The token cache is being invalidate because project 60f6faa206004295afc3a30c99aeb01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:12.240343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.242643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.247786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1006/2007] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:12 2022] DELETE /identity/v3/projects/60f6faa206004295afc3a30c99aeb01f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:12.251817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.255209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:12.337510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0af24-9cd7-432d-b414-aca6d0ffc2d5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.353279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.354139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.354449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.355164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.356722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.360318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.378533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce0604-6fef-4d4c-9a4d-b4888a640188 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.384967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.386973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.387265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.387722 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] PATH_INFO: `/v3/users/41274e034bfd48e6a1e22aa73ddf89d5` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.389710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41274e034bfd48e6a1e22aa73ddf89d5)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.393731 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1002/2008] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:12 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:12.393874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.394833 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.398819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:12.418961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa808c0-1697-476c-93e0-3cb900c1f38d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.425881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.426762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.427077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.427371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.428163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.429807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.441432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1003/2009] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:12.445316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.449661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41274e034bfd48e6a1e22aa73ddf89d5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.456204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a66cbe-b29a-40c9-a348-163c68fecd7e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.457442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41274e034bfd48e6a1e22aa73ddf89d5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.461198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.462114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.462676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.462676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] PATH_INFO: `/v3/projects/035234d39a2146c6b5036e9f73197b9b/users/47d5b12a78ae4f4c9a3a7367884c603d/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.472365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41274e034bfd48e6a1e22aa73ddf89d5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.479925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] RBAC: Authorizing `identity:create_grant(project_id=035234d39a2146c6b5036e9f73197b9b, user_id=47d5b12a78ae4f4c9a3a7367884c603d, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.481918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41274e034bfd48e6a1e22aa73ddf89d5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.483409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41274e034bfd48e6a1e22aa73ddf89d5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:12.483588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.492688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1007/2010] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:12 2022] DELETE /identity/v3/users/41274e034bfd48e6a1e22aa73ddf89d5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:12.498839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1004/2011] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:12 2022] PUT /identity/v3/projects/035234d39a2146c6b5036e9f73197b9b/users/47d5b12a78ae4f4c9a3a7367884c603d/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:12.502542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.504131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:12.580427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3663532-5fdf-4f78-9012-6010ce9148e8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.649864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.650549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.650835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.651099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.652158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.653558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.666708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1008/2012] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:12.672329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.687840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c1d97-eff2-4ab8-b31d-805c73bb606b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.693866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b9531-6ca1-4d2c-8d02-c914d3e3dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.694781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9531-6ca1-4d2c-8d02-c914d3e3dd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.695631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9531-6ca1-4d2c-8d02-c914d3e3dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.695936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9531-6ca1-4d2c-8d02-c914d3e3dd16 admin admin] PATH_INFO: `/v3/projects/035234d39a2146c6b5036e9f73197b9b/users/47d5b12a78ae4f4c9a3a7367884c603d/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.698062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b9531-6ca1-4d2c-8d02-c914d3e3dd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035234d39a2146c6b5036e9f73197b9b, user_id=47d5b12a78ae4f4c9a3a7367884c603d, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.701537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b9531-6ca1-4d2c-8d02-c914d3e3dd16 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:12.718485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1005/2013] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:12 2022] PUT /identity/v3/projects/035234d39a2146c6b5036e9f73197b9b/users/47d5b12a78ae4f4c9a3a7367884c603d/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:12.830472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:12.835924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:12.862602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224442-03ce-4614-8273-6ce6f6274615 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:12.966465 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:12.967820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:12.968290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:12.968800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] PATH_INFO: `/v3/projects/720b0f83dc1149e4a00cfbb8e8d98c42` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:12.970597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=720b0f83dc1149e4a00cfbb8e8d98c42)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:12.972696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:13.049523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720b0f83dc1149e4a00cfbb8e8d98c42', 'request_id': 'req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:13.057075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720b0f83dc1149e4a00cfbb8e8d98c42', 'request_id': 'req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:13.072919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720b0f83dc1149e4a00cfbb8e8d98c42', 'request_id': 'req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:13.094859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] The token cache is being invalidate because project 720b0f83dc1149e4a00cfbb8e8d98c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:13.095376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:13.097252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ae1dddda-8ce8-42ce-b061-7dcfeb0ea04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:13.108287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1009/2014] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:12 2022] DELETE /identity/v3/projects/720b0f83dc1149e4a00cfbb8e8d98c42 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:13.110146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101ce31-f353-49b6-b678-b663b70591ae None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.110582 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101ce31-f353-49b6-b678-b663b70591ae None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.110740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101ce31-f353-49b6-b678-b663b70591ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.147164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e101ce31-f353-49b6-b678-b663b70591ae None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:13.148436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e101ce31-f353-49b6-b678-b663b70591ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:13.278328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1006/2015] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:13.286771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8b808-5a3c-4d6d-8638-511ab2480f7e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.287065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8b808-5a3c-4d6d-8638-511ab2480f7e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.287442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8b808-5a3c-4d6d-8638-511ab2480f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.307653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-74d8b808-5a3c-4d6d-8638-511ab2480f7e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:13.308876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-74d8b808-5a3c-4d6d-8638-511ab2480f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:13.324369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101ce31-f353-49b6-b678-b663b70591ae None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:13.333142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1010/2016] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:13.337108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101ce31-f353-49b6-b678-b663b70591ae None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:13.344185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:13.345133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.345592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.346086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.346882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:13.347195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:13.348903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:13.383873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8b808-5a3c-4d6d-8638-511ab2480f7e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:13.394349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8b808-5a3c-4d6d-8638-511ab2480f7e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:13.395331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1007/2017] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:36:13.408971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:13.408971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.408971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.408971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.409302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:13.409302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:13.467209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:13.473576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1011/2018] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:13 2022] POST /identity/v3/projects => generated 357 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:13.493735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb280f-20fc-45b1-919a-5b656a48690d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:13.565144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:13.565144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.565144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.565598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.566050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:13.568566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:13.597770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1008/2019] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:13 2022] POST /identity/v3/users => generated 279 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:13.601844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:13.622251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195cd1a-266a-455b-a6c9-139cdd028aea admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:13.652542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:13.652542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.652542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.652542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.665275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:13.666971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:13.688212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1012/2020] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:13.689027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:13.702300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e7f36-0318-4f6d-bc42-b9cc60eafcd8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:13.713414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45945-e48d-4b46-8a88-fa193f7a8816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:13.714457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45945-e48d-4b46-8a88-fa193f7a8816 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.714568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45945-e48d-4b46-8a88-fa193f7a8816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.714876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45945-e48d-4b46-8a88-fa193f7a8816 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.715797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45945-e48d-4b46-8a88-fa193f7a8816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:13.718023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45945-e48d-4b46-8a88-fa193f7a8816 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:13.736809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1009/2021] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:13.741315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:13.755289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6e6ed-11f9-465b-b4ee-3074f28153b8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:13.761206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:13.762195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.762535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.762896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] PATH_INFO: `/v3/projects/39f60ed2926b4a20a3540086963572d8/users/a3a535e38779407b9f8c12b2a06af805/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.782278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f60ed2926b4a20a3540086963572d8, user_id=a3a535e38779407b9f8c12b2a06af805, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:13.786289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:13.803107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1013/2022] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:13 2022] PUT /identity/v3/projects/39f60ed2926b4a20a3540086963572d8/users/a3a535e38779407b9f8c12b2a06af805/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:13.815283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a4e6-7f3a-4264-8c34-792a2a4719fe None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:13.815710 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a4e6-7f3a-4264-8c34-792a2a4719fe None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:13.816135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a4e6-7f3a-4264-8c34-792a2a4719fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:13.860949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bc00a4e6-7f3a-4264-8c34-792a2a4719fe None None] MFA Rules not processed for user `a3a535e38779407b9f8c12b2a06af805`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:13.862229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bc00a4e6-7f3a-4264-8c34-792a2a4719fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:13.955639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1010/2023] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:13.960489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:14.031457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaf28d-e6b6-40b5-849f-ed2e9bec04e1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:14.036497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:14.037284 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.037575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.037852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.038557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:14.040602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:14.072336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1014/2024] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:13 2022] POST /identity/v3/projects => generated 357 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:14.076748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00a4e6-7f3a-4264-8c34-792a2a4719fe None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:14.089220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00a4e6-7f3a-4264-8c34-792a2a4719fe None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:14.162395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:14.163346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.163597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.164170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.165079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:14.167022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:14.194556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1011/2025] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:14 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:36:14.198909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:14.211426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529073f0-80a3-4f97-9911-15b4c2e7174a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:14.221376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:14.223325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.225157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.225450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.226828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:14.229017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:14.251888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1015/2026] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:14.253111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:14.264910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed0809-5908-4e3b-be46-ece5f70b557c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:14.269980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:14.271082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.271207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.271495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] PATH_INFO: `/v3/projects/f66f1a1104f54132b234ec3cd99caf95/users/0dfb07ff31d14010b96075a5c02f9529/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.292576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66f1a1104f54132b234ec3cd99caf95, user_id=0dfb07ff31d14010b96075a5c02f9529, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:14.298392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:14.323176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:14.323932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1012/2027] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:14 2022] PUT /identity/v3/projects/f66f1a1104f54132b234ec3cd99caf95/users/0dfb07ff31d14010b96075a5c02f9529/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:14.339428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8be368-3d8f-4bc6-b6a0-d91c6238203d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:14.404331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a96042-f6d0-4059-bfeb-3b722ef3ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:14.405562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a96042-f6d0-4059-bfeb-3b722ef3ea84 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.405911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a96042-f6d0-4059-bfeb-3b722ef3ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.406265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a96042-f6d0-4059-bfeb-3b722ef3ea84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.407255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a96042-f6d0-4059-bfeb-3b722ef3ea84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:14.409137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a96042-f6d0-4059-bfeb-3b722ef3ea84 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:14.424550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1016/2028] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:14.426256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:14.465499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ec94-f228-415c-9328-4683efb64ffd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:14.471553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:14.473031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.473031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.473230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] PATH_INFO: `/v3/projects/f66f1a1104f54132b234ec3cd99caf95/users/0dfb07ff31d14010b96075a5c02f9529/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.475216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66f1a1104f54132b234ec3cd99caf95, user_id=0dfb07ff31d14010b96075a5c02f9529, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:14.477911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:14.509667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1013/2029] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:14 2022] PUT /identity/v3/projects/f66f1a1104f54132b234ec3cd99caf95/users/0dfb07ff31d14010b96075a5c02f9529/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:14.510933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b94f-7ad7-4b82-888f-76cb772bf8d7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.511228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b94f-7ad7-4b82-888f-76cb772bf8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.511618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b94f-7ad7-4b82-888f-76cb772bf8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.560981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-8610b94f-7ad7-4b82-888f-76cb772bf8d7 None None] MFA Rules not processed for user `0dfb07ff31d14010b96075a5c02f9529`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:14.563258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8610b94f-7ad7-4b82-888f-76cb772bf8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:14.703720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1017/2030] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:14 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:14.713854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:14.715907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:14.843769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7b1cc-e292-45ac-98d0-bafd9598c1f6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:14.848603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531ff5-f6ef-47cf-9b96-de12c7e7a1e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:14.849308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531ff5-f6ef-47cf-9b96-de12c7e7a1e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:14.849577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531ff5-f6ef-47cf-9b96-de12c7e7a1e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:14.850001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531ff5-f6ef-47cf-9b96-de12c7e7a1e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:14.861393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9531ff5-f6ef-47cf-9b96-de12c7e7a1e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:14.863481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9531ff5-f6ef-47cf-9b96-de12c7e7a1e2 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:14.893273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1014/2031] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:14.988476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b94f-7ad7-4b82-888f-76cb772bf8d7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:15.000196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b94f-7ad7-4b82-888f-76cb772bf8d7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:15.008706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38afd6f-4504-43e0-9bb5-865d77939978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:15.010132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38afd6f-4504-43e0-9bb5-865d77939978 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:15.010850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38afd6f-4504-43e0-9bb5-865d77939978 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:15.011349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38afd6f-4504-43e0-9bb5-865d77939978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:15.100924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38afd6f-4504-43e0-9bb5-865d77939978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:15.102686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38afd6f-4504-43e0-9bb5-865d77939978 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:15.115108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1018/2032] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:18.025813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:18.026346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:18.026423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:18.065367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] MFA Rules not processed for user `93bd2a35edc74582b837a2e76b92bc93`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:18.066903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:18.189583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1015/2033] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:20.931174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:20.931657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:20.931856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:20.973565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] MFA Rules not processed for user `47d5b12a78ae4f4c9a3a7367884c603d`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:20.974803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.094677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1019/2034] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:21.102602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:21.103957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.197233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35fabb-a934-4725-99ed-664b99b271cd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:21.204530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:21.205006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:21.205909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:21.206381 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:21.206798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:21.207593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.209013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.304598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:21.305539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b13a9a-fc3e-43a4-8c25-90427cd60e47 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:21.306075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:21.310780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:21.312083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:21.312547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:21.313004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] PATH_INFO: `/v3/users/325ef40c4b324d7495f0407a57b9b3ab` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:21.314612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=325ef40c4b324d7495f0407a57b9b3ab)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:21.319902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:21.323518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1016/2035] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:21.383144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325ef40c4b324d7495f0407a57b9b3ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.393205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325ef40c4b324d7495f0407a57b9b3ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.414614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325ef40c4b324d7495f0407a57b9b3ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.439965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325ef40c4b324d7495f0407a57b9b3ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.441266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1596a6de-4099-42be-a552-508f5dce09ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325ef40c4b324d7495f0407a57b9b3ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.454834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1020/2036] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:21 2022] DELETE /identity/v3/users/325ef40c4b324d7495f0407a57b9b3ab => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:21.495164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:21.498579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.525566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ec1c5-06bc-48bc-bde0-db9a2210574a service glance] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:21.532899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:21.533192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:21.533472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:21.558514 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:21.559721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.660500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:21.661930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:21.662360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:21.662808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] PATH_INFO: `/v3/users/21e70fb77054476785c3809aa6e120bd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:21.665648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e70fb77054476785c3809aa6e120bd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:21.669134 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:21.721770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1021/2037] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:21.730758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:21.733104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.805203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e70fb77054476785c3809aa6e120bd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.819836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e70fb77054476785c3809aa6e120bd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.830424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e70fb77054476785c3809aa6e120bd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.831846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad828f-471c-4dbe-9281-5b432652755e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:21.838096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:21.838763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:21.839315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:21.839539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:21.847131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e70fb77054476785c3809aa6e120bd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.851311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:21.852021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e70fb77054476785c3809aa6e120bd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:21.853144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:21.861874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1017/2038] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:21 2022] DELETE /identity/v3/users/21e70fb77054476785c3809aa6e120bd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:21.862724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:21.886666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:21.888886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1022/2039] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:36:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:36:22.054576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8671c1-9a55-4afa-be8f-a18e0e30a151 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:22.067043 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:22.068122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:22.068408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:22.068944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] PATH_INFO: `/v3/projects/50c4f08e6606441bb08a6fd4f888c387` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:22.074419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c4f08e6606441bb08a6fd4f888c387)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:22.077205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:22.173860 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c4f08e6606441bb08a6fd4f888c387', 'request_id': 'req-2e523e6e-45c6-4b36-a08b-498ad5678b33'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.184651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:22.185672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c4f08e6606441bb08a6fd4f888c387', 'request_id': 'req-2e523e6e-45c6-4b36-a08b-498ad5678b33'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.186961 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:22.197206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c4f08e6606441bb08a6fd4f888c387', 'request_id': 'req-2e523e6e-45c6-4b36-a08b-498ad5678b33'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.217803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c9177-1b2e-40eb-b4a7-5b7373629888 service swift] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:22.225294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] The token cache is being invalidate because project 50c4f08e6606441bb08a6fd4f888c387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:22.225692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.227544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2e523e6e-45c6-4b36-a08b-498ad5678b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.247050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1018/2040] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:21 2022] DELETE /identity/v3/projects/50c4f08e6606441bb08a6fd4f888c387 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:22.258995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac550-c85e-4285-b95c-a86be8dfa07b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:22.260349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac550-c85e-4285-b95c-a86be8dfa07b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:22.261380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac550-c85e-4285-b95c-a86be8dfa07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:22.288815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-371ac550-c85e-4285-b95c-a86be8dfa07b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:22.290280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-371ac550-c85e-4285-b95c-a86be8dfa07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:22.302277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:22.303302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:22.303614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:22.303897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] PATH_INFO: `/v3/projects/54251ae5f1f74ba7826b0d471098d71a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:22.305115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54251ae5f1f74ba7826b0d471098d71a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:22.319773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:22.385990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54251ae5f1f74ba7826b0d471098d71a', 'request_id': 'req-004616af-173e-4990-b025-3d280bdb443b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.394052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54251ae5f1f74ba7826b0d471098d71a', 'request_id': 'req-004616af-173e-4990-b025-3d280bdb443b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.402116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54251ae5f1f74ba7826b0d471098d71a', 'request_id': 'req-004616af-173e-4990-b025-3d280bdb443b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.438901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] The token cache is being invalidate because project 54251ae5f1f74ba7826b0d471098d71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:22.439351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.440206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.443803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1023/2041] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:22 2022] DELETE /identity/v3/projects/54251ae5f1f74ba7826b0d471098d71a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:22.449446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:22.453031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:22.458720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1019/2042] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:22.471689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8de00-0c11-4c6e-bd7d-37c97d591b0f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:22.472026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8de00-0c11-4c6e-bd7d-37c97d591b0f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:22.472251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8de00-0c11-4c6e-bd7d-37c97d591b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:22.507660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-02a8de00-0c11-4c6e-bd7d-37c97d591b0f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:22.509078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-02a8de00-0c11-4c6e-bd7d-37c97d591b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:22.622952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1020/2043] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:22.626333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8de00-0c11-4c6e-bd7d-37c97d591b0f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:22.637672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004616af-173e-4990-b025-3d280bdb443b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:22.672003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:22.673259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:22.673730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:22.675221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] PATH_INFO: `/v3/users/04dfbe48c39248a5bf1611e120fe6ce5` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:22.677256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04dfbe48c39248a5bf1611e120fe6ce5)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:22.679506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:22.681429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8de00-0c11-4c6e-bd7d-37c97d591b0f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:22.692009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:22.693289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:22.693714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:22.694127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:22.696002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:22.696425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:22.712896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:22.771570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1021/2044] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:36:22.774855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:22.801644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233005d4-dcc2-4f43-a270-69a20b54d97e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:22.801842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04dfbe48c39248a5bf1611e120fe6ce5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.807190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:22.807991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:22.808270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:22.808572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:22.810601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:22.812000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:22.824301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04dfbe48c39248a5bf1611e120fe6ce5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.860628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04dfbe48c39248a5bf1611e120fe6ce5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.865603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1022/2045] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:22 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:22.870413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:22.879068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04dfbe48c39248a5bf1611e120fe6ce5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.879863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04dfbe48c39248a5bf1611e120fe6ce5'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:22.891079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1024/2046] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:22 2022] DELETE /identity/v3/users/04dfbe48c39248a5bf1611e120fe6ce5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:22.957426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab14aa-4f88-4946-8be2-4d21f35eba08 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:23.030131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:23.030836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.031122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.031434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.032155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:23.034104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:23.091561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1023/2047] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:22 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:23.095660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:23.097413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:23.131693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b7b65-5c1c-4942-bbd9-8b0ab9c61dc5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:23.145228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:23.147519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.147679 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.149085 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.151764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:23.158747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:23.196685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1025/2048] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:23.201753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:23.203044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:23.205674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:23.220424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc75ea-2a1b-4ba1-8549-615fe873f3be admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:23.222506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a26b9-250b-4aad-8d91-86112a16a789 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:23.235900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:23.237153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.237504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.237847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] PATH_INFO: `/v3/projects/7f435b94e34d46e6bc1ee2731a6574d0` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.239373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f435b94e34d46e6bc1ee2731a6574d0)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:23.242286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:23.243455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:23.244212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.244502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.244783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.245608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:23.258239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:23.289144 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1024/2049] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:23.293747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:23.352464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216b9b9-f525-4c4c-83b3-2c8134f53e95 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:23.371978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f435b94e34d46e6bc1ee2731a6574d0', 'request_id': 'req-a896ace4-3740-40f6-b47f-c0d9d6884246'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:23.389356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f435b94e34d46e6bc1ee2731a6574d0', 'request_id': 'req-a896ace4-3740-40f6-b47f-c0d9d6884246'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:23.409107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f435b94e34d46e6bc1ee2731a6574d0', 'request_id': 'req-a896ace4-3740-40f6-b47f-c0d9d6884246'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:23.437204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] The token cache is being invalidate because project 7f435b94e34d46e6bc1ee2731a6574d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:23.437538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:23.438531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a896ace4-3740-40f6-b47f-c0d9d6884246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:23.440606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1026/2050] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:23 2022] DELETE /identity/v3/projects/7f435b94e34d46e6bc1ee2731a6574d0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:23.446987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9203-b189-42f8-8aa2-b7cf5a10bda0 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.447378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9203-b189-42f8-8aa2-b7cf5a10bda0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.447855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d9203-b189-42f8-8aa2-b7cf5a10bda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.546723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943be52a-3a8a-4b60-b283-1401ff581483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:23.547729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943be52a-3a8a-4b60-b283-1401ff581483 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.548021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943be52a-3a8a-4b60-b283-1401ff581483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.548480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943be52a-3a8a-4b60-b283-1401ff581483 admin admin] PATH_INFO: `/v3/projects/52942ef9b3ad4db6a73c942e229efcdd/users/fbd55a26e6c142cb86c45ab2145ea7ce/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.553953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-359d9203-b189-42f8-8aa2-b7cf5a10bda0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:23.575746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-359d9203-b189-42f8-8aa2-b7cf5a10bda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:23.595963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943be52a-3a8a-4b60-b283-1401ff581483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52942ef9b3ad4db6a73c942e229efcdd, user_id=fbd55a26e6c142cb86c45ab2145ea7ce, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:23.598659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943be52a-3a8a-4b60-b283-1401ff581483 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:23.626049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1027/2051] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:23.628043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6341d1-dfae-46b2-b7cd-a61362a83521 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.631552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6341d1-dfae-46b2-b7cd-a61362a83521 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.632069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6341d1-dfae-46b2-b7cd-a61362a83521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.664708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1025/2052] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:23 2022] PUT /identity/v3/projects/52942ef9b3ad4db6a73c942e229efcdd/users/fbd55a26e6c142cb86c45ab2145ea7ce/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:23.668001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:23.668499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:23.668947 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:23.798323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9b6341d1-dfae-46b2-b7cd-a61362a83521 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:23.799546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9b6341d1-dfae-46b2-b7cd-a61362a83521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:23.800424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] MFA Rules not processed for user `fbd55a26e6c142cb86c45ab2145ea7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:23.802067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:24.017554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1028/2053] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:24.021554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6341d1-dfae-46b2-b7cd-a61362a83521 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.034611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1026/2054] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:24.036357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.039416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6341d1-dfae-46b2-b7cd-a61362a83521 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.040269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:24.061092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.061817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.062190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.062503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.063497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:24.063497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.065135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.077393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06e0a-ed42-4c32-b67a-193b7a9e10bc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.103227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.103940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.104227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.107928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.111838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.118889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.126074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1029/2055] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:36:24.134120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.174583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156663b-107c-4adb-95e5-fe53f9bf2829 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.191275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.191997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.192282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.192575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.193196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1027/2056] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:24 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:24.193323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.195235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.199334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.261224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1030/2057] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:24 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:24.266191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.377786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d285c1-9b47-47fc-b2e0-68861f989863 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.384635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.385432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.385780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.386132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.387673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.390786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.391316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f11f2-f8f3-4bde-8c7c-a2035944d54b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.403127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.404886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.405226 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.405568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.406731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.411033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.429700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1028/2058] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:24 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:24.444880 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.459806 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1031/2059] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:24 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:24.461211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.477996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640a4f8-4edb-4002-b624-e92ae5512990 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.493635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.494894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.495177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.495498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.496765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.501248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.522469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22c12-a830-42c3-9a85-72f9f3f9105c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.528964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1032/2060] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:24.531843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.538655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.539512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.539901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.540281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.548060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.551162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.557115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0956d1-c2a4-4ed2-960e-404cc25d33ba admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.569979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.574058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.574391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.574680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.577071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.581239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.604693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1029/2061] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:24.609215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.617768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1033/2062] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:24.620292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.646012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be183c2-e67d-4b8c-80b2-ca5dbb518b5b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.658771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254dda4-8cf1-405b-a733-672c033bb35b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:24.688327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.690168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.690310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b302e-8bed-4014-a479-a2a46a10a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:24.691033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b302e-8bed-4014-a479-a2a46a10a90d admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.691315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b302e-8bed-4014-a479-a2a46a10a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.691650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b302e-8bed-4014-a479-a2a46a10a90d admin admin] PATH_INFO: `/v3/projects/d116a4775cc34bb1ab60141f58d0f62a/users/787eb04947a74a8caea2aff696ea810f/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.695261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.695630 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] PATH_INFO: `/v3/projects/f81b17b0ba354d4882261024689e21d1/users/e7d453290df941b1b6f953392e15f5b6/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.739704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81b17b0ba354d4882261024689e21d1, user_id=e7d453290df941b1b6f953392e15f5b6, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.742592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.745348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b302e-8bed-4014-a479-a2a46a10a90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d116a4775cc34bb1ab60141f58d0f62a, user_id=787eb04947a74a8caea2aff696ea810f, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:24.757327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b302e-8bed-4014-a479-a2a46a10a90d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:24.790878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1030/2063] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:24 2022] PUT /identity/v3/projects/f81b17b0ba354d4882261024689e21d1/users/e7d453290df941b1b6f953392e15f5b6/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:24.796640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:24.799839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1034/2064] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:24 2022] PUT /identity/v3/projects/d116a4775cc34bb1ab60141f58d0f62a/users/787eb04947a74a8caea2aff696ea810f/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:24.814170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:24.814170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:24.814655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:24.907802 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] MFA Rules not processed for user `787eb04947a74a8caea2aff696ea810f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:24.909285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:25.053093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3eb5b-dc91-4936-baf9-93b645df588d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:25.053670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1035/2065] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:25.062438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:25.064734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:25.177015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:25.177962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:25.178424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:25.178899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:25.186740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:25.188478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:25.195428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0bfda-f200-48d4-ac3c-64dbd3430ded None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:25.206472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e4d32-80f1-4fbf-9c7c-6d00657d7746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:25.208715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e4d32-80f1-4fbf-9c7c-6d00657d7746 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:25.208894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1031/2066] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:25.213667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e4d32-80f1-4fbf-9c7c-6d00657d7746 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:25.213667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e4d32-80f1-4fbf-9c7c-6d00657d7746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:25.215447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:25.229989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b064859-f80e-4948-a8a7-ee8a87396e69 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:25.242708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e4d32-80f1-4fbf-9c7c-6d00657d7746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:25.246322 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e4d32-80f1-4fbf-9c7c-6d00657d7746 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:25.252249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:25.253627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:25.254099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:25.254562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] PATH_INFO: `/v3/projects/f81b17b0ba354d4882261024689e21d1/users/e7d453290df941b1b6f953392e15f5b6/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:25.258283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81b17b0ba354d4882261024689e21d1, user_id=e7d453290df941b1b6f953392e15f5b6, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:25.261505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:25.273548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1036/2067] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:25.298831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1032/2068] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:25 2022] PUT /identity/v3/projects/f81b17b0ba354d4882261024689e21d1/users/e7d453290df941b1b6f953392e15f5b6/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:25.310578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77b69-fb26-497f-a050-7bdfbbdcfa61 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:25.311003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77b69-fb26-497f-a050-7bdfbbdcfa61 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:25.311256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77b69-fb26-497f-a050-7bdfbbdcfa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:25.403056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f1a77b69-fb26-497f-a050-7bdfbbdcfa61 None None] MFA Rules not processed for user `e7d453290df941b1b6f953392e15f5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:25.405129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f1a77b69-fb26-497f-a050-7bdfbbdcfa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:25.691121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1037/2069] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:25.807490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:25.810325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:25.968180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daee5b6-313a-4fd4-9a92-d2cae8590afb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:25.982825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36ba37-8899-477c-b889-2c1f7a25fd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:25.983806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36ba37-8899-477c-b889-2c1f7a25fd3d service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:25.984309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36ba37-8899-477c-b889-2c1f7a25fd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:25.984796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36ba37-8899-477c-b889-2c1f7a25fd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:25.994890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36ba37-8899-477c-b889-2c1f7a25fd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:25.996723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36ba37-8899-477c-b889-2c1f7a25fd3d service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:26.032172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1033/2070] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:27.014206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77b69-fb26-497f-a050-7bdfbbdcfa61 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:27.114717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77b69-fb26-497f-a050-7bdfbbdcfa61 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:27.120664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:27.122739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:27.123212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:27.123706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] PATH_INFO: `/v3/users/fbd55a26e6c142cb86c45ab2145ea7ce` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:27.126757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd55a26e6c142cb86c45ab2145ea7ce)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:27.129525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:27.211654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd55a26e6c142cb86c45ab2145ea7ce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:27.220800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd55a26e6c142cb86c45ab2145ea7ce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:27.235669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd55a26e6c142cb86c45ab2145ea7ce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:27.245563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd55a26e6c142cb86c45ab2145ea7ce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:27.247371 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd55a26e6c142cb86c45ab2145ea7ce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:27.264070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1038/2071] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:27 2022] DELETE /identity/v3/users/fbd55a26e6c142cb86c45ab2145ea7ce => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:27.268706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:27.270364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:27.270945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:27.342598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:27.346162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:27.437000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1034/2072] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:27.449881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:27.453422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:27.547134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7a91c-a741-43e8-afd8-e6415aa116a7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:27.554682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:27.557160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:27.557703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:27.557817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:27.568896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:27.571653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:27.584690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1039/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:28.245217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:28.247625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:28.261803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829d52-4e5c-4c03-8c4f-d161434653ef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:28.267929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:28.268806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:28.269374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:28.269374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] PATH_INFO: `/v3/projects/52942ef9b3ad4db6a73c942e229efcdd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:28.270810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52942ef9b3ad4db6a73c942e229efcdd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:28.273061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:28.341853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52942ef9b3ad4db6a73c942e229efcdd', 'request_id': 'req-3073a566-2e49-442f-8b9a-03505f7dee65'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.352651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52942ef9b3ad4db6a73c942e229efcdd', 'request_id': 'req-3073a566-2e49-442f-8b9a-03505f7dee65'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.359849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52942ef9b3ad4db6a73c942e229efcdd', 'request_id': 'req-3073a566-2e49-442f-8b9a-03505f7dee65'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.373811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] The token cache is being invalidate because project 52942ef9b3ad4db6a73c942e229efcdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:28.374366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.375694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.377350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1035/2074] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:28 2022] DELETE /identity/v3/projects/52942ef9b3ad4db6a73c942e229efcdd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:28.382526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:28.393628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d0598-a126-4353-b553-e3818e962461 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:28.459668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:28.460535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:28.461012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:28.461587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] PATH_INFO: `/v3/users/e7d453290df941b1b6f953392e15f5b6` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:28.462853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d453290df941b1b6f953392e15f5b6)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:28.464826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:28.518420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d453290df941b1b6f953392e15f5b6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.531148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d453290df941b1b6f953392e15f5b6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.548995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d453290df941b1b6f953392e15f5b6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.561794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d453290df941b1b6f953392e15f5b6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.563178 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e9d7cdca-09f2-4315-b99b-21e5a6b53f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d453290df941b1b6f953392e15f5b6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:28.570746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1040/2075] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:28 2022] DELETE /identity/v3/users/e7d453290df941b1b6f953392e15f5b6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:28.943499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:28.945226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:28.961852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073a566-2e49-442f-8b9a-03505f7dee65 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.036098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.036876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.037159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.037436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] PATH_INFO: `/v3/projects/f81b17b0ba354d4882261024689e21d1` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.038660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81b17b0ba354d4882261024689e21d1)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.040601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.110600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81b17b0ba354d4882261024689e21d1', 'request_id': 'req-bb54a49d-7f8f-4b08-aac2-a4306a611957'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:29.124807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81b17b0ba354d4882261024689e21d1', 'request_id': 'req-bb54a49d-7f8f-4b08-aac2-a4306a611957'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:29.133577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81b17b0ba354d4882261024689e21d1', 'request_id': 'req-bb54a49d-7f8f-4b08-aac2-a4306a611957'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:29.147223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] The token cache is being invalidate because project f81b17b0ba354d4882261024689e21d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:29.147223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:29.148084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bb54a49d-7f8f-4b08-aac2-a4306a611957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:29.149957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1036/2076] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:28 2022] DELETE /identity/v3/projects/f81b17b0ba354d4882261024689e21d1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:29.156277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a357f0-4583-44b0-8b26-c8982d85508d None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.156574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a357f0-4583-44b0-8b26-c8982d85508d None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.156808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a357f0-4583-44b0-8b26-c8982d85508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.180450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d4a357f0-4583-44b0-8b26-c8982d85508d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:29.182501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d4a357f0-4583-44b0-8b26-c8982d85508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:29.310255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1041/2077] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:29.312103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb228e-12fb-467e-a621-a122a5b7c183 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.312557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb228e-12fb-467e-a621-a122a5b7c183 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.312650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb228e-12fb-467e-a621-a122a5b7c183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.333077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0ecb228e-12fb-467e-a621-a122a5b7c183 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:29.334257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0ecb228e-12fb-467e-a621-a122a5b7c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:29.344410 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1037/2078] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:29.348853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a357f0-4583-44b0-8b26-c8982d85508d None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.359976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a357f0-4583-44b0-8b26-c8982d85508d None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.364691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.365364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.365648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.365927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.366670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:29.366983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.368668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.384641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1042/2079] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:36:29.386551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb228e-12fb-467e-a621-a122a5b7c183 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.397272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb228e-12fb-467e-a621-a122a5b7c183 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.402074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.402806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.403187 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.404099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.405142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.407065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.434834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1038/2080] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:29 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:36:29.439252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.452383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441888f4-85e9-4b5a-addb-e8ace1c5d85e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.518093 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.518714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.521306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.521616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.522363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.524342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.550909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1043/2081] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:29 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:29.552479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.567481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845709-8133-45e3-aa8b-2e4ce41e90fa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.575105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.575832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.576119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.576400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.577160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.578815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.590703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1039/2082] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:29.594568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.604833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba473cc-04ff-4fcf-9acf-0e1a375aa755 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.611103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bae726-600d-4ea6-87fd-49055f168ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.611907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bae726-600d-4ea6-87fd-49055f168ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.612260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bae726-600d-4ea6-87fd-49055f168ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.612622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bae726-600d-4ea6-87fd-49055f168ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.613437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bae726-600d-4ea6-87fd-49055f168ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.615109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bae726-600d-4ea6-87fd-49055f168ae2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.627441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1044/2083] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:29.630573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.641764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4bb3-ce05-422b-8360-9d8097519a9e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.647550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.648459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.648741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.649022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] PATH_INFO: `/v3/projects/50fd226a13fb4123a94b5a7aec5df87a/users/2eb811f0000041d79c184ba7a612bd83/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.667142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fd226a13fb4123a94b5a7aec5df87a, user_id=2eb811f0000041d79c184ba7a612bd83, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.669978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.691563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1040/2084] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:29 2022] PUT /identity/v3/projects/50fd226a13fb4123a94b5a7aec5df87a/users/2eb811f0000041d79c184ba7a612bd83/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:29.702843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cc5b-428f-4e48-a681-3313ae76283a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.703367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cc5b-428f-4e48-a681-3313ae76283a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.703927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cc5b-428f-4e48-a681-3313ae76283a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.738258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-1e30cc5b-428f-4e48-a681-3313ae76283a None None] MFA Rules not processed for user `2eb811f0000041d79c184ba7a612bd83`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:29.739500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1e30cc5b-428f-4e48-a681-3313ae76283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:29.825397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1045/2085] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:29.831963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.922780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e308-f146-4b7e-9c4d-207c4a3268e1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:29.928023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:29.928692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:29.928972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:29.929250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:29.929974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:29.932979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:29.977512 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1041/2086] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:29 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:29.982095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30cc5b-428f-4e48-a681-3313ae76283a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:29.994096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30cc5b-428f-4e48-a681-3313ae76283a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:30.071125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:30.071851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.072136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.072415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.073131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:30.075099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:30.096898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1046/2087] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:29 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:30.100903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:30.112001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742bc7f-86d2-4a26-962c-86f217750199 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:30.118726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:30.119516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.119870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.120257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.121078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:30.123416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:30.138460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1042/2088] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:30.142647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:30.154372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181c05-e7e0-466e-b7f9-651d045b4dd1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:30.159768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:30.160740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.161121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.161475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] PATH_INFO: `/v3/projects/30d338d8568c4a319ad048520ac915bd/users/7a529edfdbd442a5a253ffb10ef3d904/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.184112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d338d8568c4a319ad048520ac915bd, user_id=7a529edfdbd442a5a253ffb10ef3d904, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:30.187853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:30.202737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1047/2089] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:30 2022] PUT /identity/v3/projects/30d338d8568c4a319ad048520ac915bd/users/7a529edfdbd442a5a253ffb10ef3d904/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:30.206544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:30.216934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db39b14-66cd-4f73-bcc5-f93c0d209a56 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:30.283025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea518a-7f78-4b95-8bd3-d25fc9ea86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:30.283742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea518a-7f78-4b95-8bd3-d25fc9ea86d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.284066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea518a-7f78-4b95-8bd3-d25fc9ea86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.284366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea518a-7f78-4b95-8bd3-d25fc9ea86d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.285434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea518a-7f78-4b95-8bd3-d25fc9ea86d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:30.286936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea518a-7f78-4b95-8bd3-d25fc9ea86d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:30.301071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1043/2090] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:30.305238 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:30.320731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb2bc-b8f5-4c6e-b646-e20ebb4d7e98 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:30.336976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:30.337955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.338309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.338680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] PATH_INFO: `/v3/projects/30d338d8568c4a319ad048520ac915bd/users/7a529edfdbd442a5a253ffb10ef3d904/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.343872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d338d8568c4a319ad048520ac915bd, user_id=7a529edfdbd442a5a253ffb10ef3d904, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:30.346849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:30.373954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1048/2091] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:30 2022] PUT /identity/v3/projects/30d338d8568c4a319ad048520ac915bd/users/7a529edfdbd442a5a253ffb10ef3d904/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:30.374607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.375420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.375848 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.407953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] MFA Rules not processed for user `7a529edfdbd442a5a253ffb10ef3d904`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:30.410067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:30.491438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1044/2092] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:30.500983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:30.502818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:30.564422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9392f-e45f-4b4f-925a-a2623be8c918 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:30.570845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50d54f-4cd6-40af-873f-a7531c40f464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:30.571548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50d54f-4cd6-40af-873f-a7531c40f464 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.571827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50d54f-4cd6-40af-873f-a7531c40f464 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.572110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50d54f-4cd6-40af-873f-a7531c40f464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.582310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50d54f-4cd6-40af-873f-a7531c40f464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:30.584118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50d54f-4cd6-40af-873f-a7531c40f464 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:30.599585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1049/2093] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:30.702719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:30.705417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:30.722973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4422bfd-1f83-44b9-a694-4349c6701cda None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:30.727562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5460b9-33ca-4f38-b7b4-68444629eda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:30.728205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5460b9-33ca-4f38-b7b4-68444629eda0 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:30.728554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5460b9-33ca-4f38-b7b4-68444629eda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:30.728821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5460b9-33ca-4f38-b7b4-68444629eda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:30.809162 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5460b9-33ca-4f38-b7b4-68444629eda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:30.811314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5460b9-33ca-4f38-b7b4-68444629eda0 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:30.821840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1045/2094] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:35.066819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:35.067366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:35.067492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:35.085280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] MFA Rules not processed for user `363a5d18ceb5439497fe406469397fea`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:35.086472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:35.141666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1050/2095] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:37.125389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:37.125930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:37.125930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:37.145181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:37.146692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:37.214564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1046/2096] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:37.227805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:37.230596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:37.344682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501556a-7cfd-4618-8e85-08d56bf22b08 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:37.353068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18717023-4d91-42ef-a2be-3fa2e2312ade service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:37.354264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717023-4d91-42ef-a2be-3fa2e2312ade service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:37.354567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717023-4d91-42ef-a2be-3fa2e2312ade service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:37.354899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18717023-4d91-42ef-a2be-3fa2e2312ade service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:37.390866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18717023-4d91-42ef-a2be-3fa2e2312ade service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:37.409965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18717023-4d91-42ef-a2be-3fa2e2312ade service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:37.424652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1051/2097] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:36:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:36:42.888597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:42.890388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:42.983202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045eeb2-9ab9-4852-ae2a-d13557a79261 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:42.988406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:42.989578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:42.989887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:42.990136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] PATH_INFO: `/v3/users/a3a535e38779407b9f8c12b2a06af805` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:42.991362 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a535e38779407b9f8c12b2a06af805)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:42.993423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:43.095447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a535e38779407b9f8c12b2a06af805'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.126744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a535e38779407b9f8c12b2a06af805'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.134692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a535e38779407b9f8c12b2a06af805'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.148291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a535e38779407b9f8c12b2a06af805'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.158403 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a535e38779407b9f8c12b2a06af805'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.173799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1047/2098] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:42 2022] DELETE /identity/v3/users/a3a535e38779407b9f8c12b2a06af805 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:43.178228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:43.178758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:43.178845 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:43.201707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:43.203726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:43.314239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1052/2099] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:43.315086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:43.316684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:43.433294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56882a-ea5c-4421-b255-82d43d707890 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:43.437790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:43.438436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:43.438722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:43.439002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:43.447937 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:43.449359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:43.460963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1048/2100] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:43.806952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:43.809142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:43.837851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149299c-0751-4f4e-b136-bc0f0157b723 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:43.843903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:43.844776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:43.845066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:43.845349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] PATH_INFO: `/v3/projects/39f60ed2926b4a20a3540086963572d8` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:43.846608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f60ed2926b4a20a3540086963572d8)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:43.848839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:43.911955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f60ed2926b4a20a3540086963572d8', 'request_id': 'req-53c06bdc-6142-4f6a-8b8f-ea41179443da'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.919213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f60ed2926b4a20a3540086963572d8', 'request_id': 'req-53c06bdc-6142-4f6a-8b8f-ea41179443da'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.925355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f60ed2926b4a20a3540086963572d8', 'request_id': 'req-53c06bdc-6142-4f6a-8b8f-ea41179443da'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.940169 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] The token cache is being invalidate because project 39f60ed2926b4a20a3540086963572d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:43.940463 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.941275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:43.943034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1053/2101] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:43 2022] DELETE /identity/v3/projects/39f60ed2926b4a20a3540086963572d8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:43.947053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:43.956977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912fbb6-7a96-429b-99bd-6eed08039b3b service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:44.018177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:44.019049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:44.019335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:44.019648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] PATH_INFO: `/v3/users/0dfb07ff31d14010b96075a5c02f9529` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:44.020855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dfb07ff31d14010b96075a5c02f9529)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:44.022783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:44.079976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dfb07ff31d14010b96075a5c02f9529'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.087519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dfb07ff31d14010b96075a5c02f9529'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.094898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dfb07ff31d14010b96075a5c02f9529'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.116570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dfb07ff31d14010b96075a5c02f9529'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.128129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f4478e4-f443-439d-bad4-56f14f2282a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dfb07ff31d14010b96075a5c02f9529'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.144475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1049/2102] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:43 2022] DELETE /identity/v3/users/0dfb07ff31d14010b96075a5c02f9529 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:44.669449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:44.670958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:44.684675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c06bdc-6142-4f6a-8b8f-ea41179443da admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:44.745657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:44.747582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:44.748152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:44.748437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] PATH_INFO: `/v3/projects/f66f1a1104f54132b234ec3cd99caf95` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:44.750042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66f1a1104f54132b234ec3cd99caf95)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:44.752693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:44.806740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66f1a1104f54132b234ec3cd99caf95', 'request_id': 'req-eb214b04-6656-4454-8f43-d4b47713c4ad'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.813757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66f1a1104f54132b234ec3cd99caf95', 'request_id': 'req-eb214b04-6656-4454-8f43-d4b47713c4ad'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.820499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66f1a1104f54132b234ec3cd99caf95', 'request_id': 'req-eb214b04-6656-4454-8f43-d4b47713c4ad'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.833999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] The token cache is being invalidate because project f66f1a1104f54132b234ec3cd99caf95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:44.834291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.834945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-eb214b04-6656-4454-8f43-d4b47713c4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:44.836556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1054/2103] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:44 2022] DELETE /identity/v3/projects/f66f1a1104f54132b234ec3cd99caf95 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:44.842927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f07e-92f2-4c35-aacf-bdb4ee3462ef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:44.843218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f07e-92f2-4c35-aacf-bdb4ee3462ef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:44.843535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f07e-92f2-4c35-aacf-bdb4ee3462ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:44.861637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-39e4f07e-92f2-4c35-aacf-bdb4ee3462ef None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:44.862883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-39e4f07e-92f2-4c35-aacf-bdb4ee3462ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:44.925189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1050/2104] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:44.933855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01dbe8-d239-4947-9b9a-87eaf9296ea4 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:44.934150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01dbe8-d239-4947-9b9a-87eaf9296ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:44.934434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01dbe8-d239-4947-9b9a-87eaf9296ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:44.953571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6e01dbe8-d239-4947-9b9a-87eaf9296ea4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:44.954790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6e01dbe8-d239-4947-9b9a-87eaf9296ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:44.964257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1055/2105] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:44.970114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f07e-92f2-4c35-aacf-bdb4ee3462ef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:44.983520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f07e-92f2-4c35-aacf-bdb4ee3462ef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:44.991187 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:44.992020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:44.992408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:44.992689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:44.993588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:44.993897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:44.995766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.008774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1051/2106] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:36:45.016535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01dbe8-d239-4947-9b9a-87eaf9296ea4 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:45.026437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01dbe8-d239-4947-9b9a-87eaf9296ea4 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:45.033110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:45.033803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.034088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.034351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.035062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:45.037032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.073814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1056/2107] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:45 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:45.078048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:45.088071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a189-026b-41fa-92ea-1714ed10db01 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:45.149620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:45.150349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.150634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.150914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.151683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:45.153649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.174408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1052/2108] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:45 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:36:45.178502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:45.189460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069489-63d7-4601-ac3d-f04406e77249 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:45.194351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:45.195032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.195320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.195643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.196411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:45.198051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.212090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1057/2109] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:45.217796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:45.229129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ab277-5961-4049-b19b-f949269bb54d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:45.234151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c39d0a-2782-4803-8ecc-7192ce0a2aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:45.234825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39d0a-2782-4803-8ecc-7192ce0a2aec admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.235112 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39d0a-2782-4803-8ecc-7192ce0a2aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.235425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39d0a-2782-4803-8ecc-7192ce0a2aec admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.236174 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c39d0a-2782-4803-8ecc-7192ce0a2aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:45.237787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c39d0a-2782-4803-8ecc-7192ce0a2aec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.248719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1053/2110] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:45.252534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:45.263936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d67f-aa28-4d36-a347-a8282326be95 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:45.269259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:45.270160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.270447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.270724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] PATH_INFO: `/v3/projects/56715da73513460c9d99c088b881e193/users/97f2d2127edb43928869ef0c35af070d/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.286081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56715da73513460c9d99c088b881e193, user_id=97f2d2127edb43928869ef0c35af070d, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:45.288730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.301742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1058/2111] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:45 2022] PUT /identity/v3/projects/56715da73513460c9d99c088b881e193/users/97f2d2127edb43928869ef0c35af070d/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:45.312386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27486968-32cf-4abf-841b-45198d378441 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.312679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27486968-32cf-4abf-841b-45198d378441 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.312962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27486968-32cf-4abf-841b-45198d378441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.360472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-27486968-32cf-4abf-841b-45198d378441 None None] MFA Rules not processed for user `97f2d2127edb43928869ef0c35af070d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:45.361720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-27486968-32cf-4abf-841b-45198d378441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:45.462103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1054/2112] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:45.463515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:45.619043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eec7c-751d-4fa7-b2fa-41d02af3304f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:45.645319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:45.646327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.646804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.647269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.648252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:45.650432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.730279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27486968-32cf-4abf-841b-45198d378441 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:45.731141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1059/2113] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:45 2022] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:36:45.756826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27486968-32cf-4abf-841b-45198d378441 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:45.919860 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:45.920559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:45.920844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:45.921146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:45.921847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:45.933598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:45.967521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1055/2114] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:45 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:45.981633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:46.004506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeedd7-b529-424c-aa2d-c2ef11debe3f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:46.024765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:46.025678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:46.025971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:46.026444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:46.027087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:46.028934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:46.063492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1060/2115] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:46.067885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:46.080696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907a27-a56d-4667-98d1-6b69da0d0174 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:46.097165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:46.098396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:46.098943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:46.100060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] PATH_INFO: `/v3/projects/8c21893ca158456b987907e73798f17a/users/e2b04bdde1854f2f8153331888f5217f/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:46.123330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c21893ca158456b987907e73798f17a, user_id=e2b04bdde1854f2f8153331888f5217f, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:46.126405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:46.149006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1056/2116] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:46 2022] PUT /identity/v3/projects/8c21893ca158456b987907e73798f17a/users/e2b04bdde1854f2f8153331888f5217f/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:46.153375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:46.170523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7704d93-27a4-44ab-8061-c678929d5cfc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:46.266576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97dda-e20f-40ca-88f0-340ccdc349e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:46.267434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97dda-e20f-40ca-88f0-340ccdc349e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:46.267829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97dda-e20f-40ca-88f0-340ccdc349e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:46.268246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97dda-e20f-40ca-88f0-340ccdc349e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:46.269197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97dda-e20f-40ca-88f0-340ccdc349e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:46.270901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97dda-e20f-40ca-88f0-340ccdc349e6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:46.282809 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1061/2117] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:46.287291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:46.300582 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165e9f-f0e4-4a20-8528-b4c17154188c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:46.306777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:46.308166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:46.308634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:46.308958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] PATH_INFO: `/v3/projects/8c21893ca158456b987907e73798f17a/users/e2b04bdde1854f2f8153331888f5217f/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:46.311038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c21893ca158456b987907e73798f17a, user_id=e2b04bdde1854f2f8153331888f5217f, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:46.313998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:46.325407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1057/2118] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:46 2022] PUT /identity/v3/projects/8c21893ca158456b987907e73798f17a/users/e2b04bdde1854f2f8153331888f5217f/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:46.336859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2d73c-b1df-4395-8758-6f94b9e6c90f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:46.337149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2d73c-b1df-4395-8758-6f94b9e6c90f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:46.337431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2d73c-b1df-4395-8758-6f94b9e6c90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:46.369545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c9b2d73c-b1df-4395-8758-6f94b9e6c90f None None] MFA Rules not processed for user `e2b04bdde1854f2f8153331888f5217f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:46.370761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c9b2d73c-b1df-4395-8758-6f94b9e6c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:46.439417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1062/2119] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:46.450449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:46.452351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:46.525463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226ed6-204b-4a38-86b2-86f0854f581c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:46.531992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:46.532967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:46.533514 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:46.534027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:46.550037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:46.551631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:46.561598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1058/2120] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:46.665193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2d73c-b1df-4395-8758-6f94b9e6c90f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:46.677797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2d73c-b1df-4395-8758-6f94b9e6c90f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:46.682053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b239acc-faf9-43f4-9ac0-17d996a6b113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:46.683861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239acc-faf9-43f4-9ac0-17d996a6b113 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:46.684394 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239acc-faf9-43f4-9ac0-17d996a6b113 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:46.684604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239acc-faf9-43f4-9ac0-17d996a6b113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:46.756266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b239acc-faf9-43f4-9ac0-17d996a6b113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:46.758251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b239acc-faf9-43f4-9ac0-17d996a6b113 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:46.770122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1063/2121] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:47.389062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:47.390547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:47.511354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349130c7-4271-44eb-a525-fb8056d7ce00 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:47.517660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:47.518539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:47.518822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:47.519101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] PATH_INFO: `/v3/users/2eb811f0000041d79c184ba7a612bd83` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:47.520367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb811f0000041d79c184ba7a612bd83)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:47.522317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:47.577751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb811f0000041d79c184ba7a612bd83'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:47.587914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb811f0000041d79c184ba7a612bd83'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:47.596943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb811f0000041d79c184ba7a612bd83'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:47.610722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb811f0000041d79c184ba7a612bd83'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:47.611570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb811f0000041d79c184ba7a612bd83'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:47.621906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1059/2122] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:47 2022] DELETE /identity/v3/users/2eb811f0000041d79c184ba7a612bd83 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:47.623170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:47.623669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:47.624215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:47.645955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:47.647307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:47.711822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1064/2123] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:47.750214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:47.751853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:47.832734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b069bd-49c5-4fd9-81ad-6d5db12c3b99 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:47.836534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:47.837186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:47.837465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:47.837739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:47.847518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:47.848977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:47.859736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1060/2124] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:48.290555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:48.292163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:48.310028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d337a2-cc68-420e-a0d5-9c632ee50a03 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:48.319465 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:48.320532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:48.320816 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:48.321086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] PATH_INFO: `/v3/projects/50fd226a13fb4123a94b5a7aec5df87a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:48.322496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fd226a13fb4123a94b5a7aec5df87a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:48.325039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:48.400745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fd226a13fb4123a94b5a7aec5df87a', 'request_id': 'req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.411518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fd226a13fb4123a94b5a7aec5df87a', 'request_id': 'req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.431250 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fd226a13fb4123a94b5a7aec5df87a', 'request_id': 'req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.463247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] The token cache is being invalidate because project 50fd226a13fb4123a94b5a7aec5df87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:48.463658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.464449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.469930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1065/2125] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:48 2022] DELETE /identity/v3/projects/50fd226a13fb4123a94b5a7aec5df87a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:48.474187 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:48.484578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9302e0b-a09d-46b4-af9f-85f944b5da78 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:48.577311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:48.578559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:48.579063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:48.579822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] PATH_INFO: `/v3/users/7a529edfdbd442a5a253ffb10ef3d904` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:48.581531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a529edfdbd442a5a253ffb10ef3d904)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:48.584406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:48.675884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a529edfdbd442a5a253ffb10ef3d904'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.692281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a529edfdbd442a5a253ffb10ef3d904'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.700100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a529edfdbd442a5a253ffb10ef3d904'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.713361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a529edfdbd442a5a253ffb10ef3d904'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.719811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d731d6-ea22-4735-b6e5-186cfb3dec25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a529edfdbd442a5a253ffb10ef3d904'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:48.729896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1061/2126] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:48 2022] DELETE /identity/v3/users/7a529edfdbd442a5a253ffb10ef3d904 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:49.098026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.100056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:49.120903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b309-f3a4-4012-a9b8-6d07bcfcc21c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.185907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.186767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.187021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.187300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] PATH_INFO: `/v3/projects/30d338d8568c4a319ad048520ac915bd` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.188575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d338d8568c4a319ad048520ac915bd)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.190832 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.248457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d338d8568c4a319ad048520ac915bd', 'request_id': 'req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.254714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d338d8568c4a319ad048520ac915bd', 'request_id': 'req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.261740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d338d8568c4a319ad048520ac915bd', 'request_id': 'req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.283915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] The token cache is being invalidate because project 30d338d8568c4a319ad048520ac915bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:49.284259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.285009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f69e3cbb-6e6d-403f-8bcb-ceba480e887f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.287014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1066/2127] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:49 2022] DELETE /identity/v3/projects/30d338d8568c4a319ad048520ac915bd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:49.294991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac857a-fcee-47b9-a5c6-72b642fef49d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.295281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac857a-fcee-47b9-a5c6-72b642fef49d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.295593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac857a-fcee-47b9-a5c6-72b642fef49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.320227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-efac857a-fcee-47b9-a5c6-72b642fef49d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:49.321913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-efac857a-fcee-47b9-a5c6-72b642fef49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:49.432079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1062/2128] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:49.442557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f2d32-859c-484f-9436-72c5278121d5 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.443123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f2d32-859c-484f-9436-72c5278121d5 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.443576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f2d32-859c-484f-9436-72c5278121d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.480216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2f7f2d32-859c-484f-9436-72c5278121d5 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:49.482562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2f7f2d32-859c-484f-9436-72c5278121d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:49.491628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1067/2129] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:49.496503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac857a-fcee-47b9-a5c6-72b642fef49d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.508443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac857a-fcee-47b9-a5c6-72b642fef49d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.515136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.516151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.516595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.517030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.518014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:49.518482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.520291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.534784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1063/2130] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:36:49.539146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f2d32-859c-484f-9436-72c5278121d5 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.549594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f2d32-859c-484f-9436-72c5278121d5 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.560522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.569633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.569633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.569633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.569633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.569633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.605076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.607608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1068/2131] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:49 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:49.617199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f53dd-87c6-4ba5-95e9-48169646d387 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.620539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.622270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:49.696831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.697444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.697733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.698014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.698730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.701247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.751446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1064/2132] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:49 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:49.754581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.778085 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624e89-d8e2-42c2-8d85-66387939bddd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.781863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee6a8b-ab86-4beb-8480-508be8775e72 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.787246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.788405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.788876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.789438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] PATH_INFO: `/v3/users/97f2d2127edb43928869ef0c35af070d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.791148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f2d2127edb43928869ef0c35af070d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.791577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.792390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.792753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.793639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.794297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.794538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.796462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.820752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1065/2133] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:49.825289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.841332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e443-f338-4109-8583-02c4e4362ed3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.847568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.848301 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.848599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.848958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.849729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.851368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.872404 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1066/2134] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:49.873463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:49.889760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a44d8-01bb-43d3-bc11-93019ed1726d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:49.897015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b86f2-ee15-4de6-b8a6-8d4cdb2c29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:49.900924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b86f2-ee15-4de6-b8a6-8d4cdb2c29bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.900924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b86f2-ee15-4de6-b8a6-8d4cdb2c29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.900924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b86f2-ee15-4de6-b8a6-8d4cdb2c29bc admin admin] PATH_INFO: `/v3/projects/9a9169a0cb4e4153a97df4d7199d7916/users/b7b34a80131a4a008afc1aa1951a36f6/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.908679 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f2d2127edb43928869ef0c35af070d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.916834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f2d2127edb43928869ef0c35af070d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.917614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b86f2-ee15-4de6-b8a6-8d4cdb2c29bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9169a0cb4e4153a97df4d7199d7916, user_id=b7b34a80131a4a008afc1aa1951a36f6, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:49.925609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b86f2-ee15-4de6-b8a6-8d4cdb2c29bc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:49.938508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f2d2127edb43928869ef0c35af070d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.951909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f2d2127edb43928869ef0c35af070d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.952680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c80cd01-d139-4e08-aeed-45d4677ff246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f2d2127edb43928869ef0c35af070d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:49.958696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1067/2135] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:49 2022] PUT /identity/v3/projects/9a9169a0cb4e4153a97df4d7199d7916/users/b7b34a80131a4a008afc1aa1951a36f6/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:49.961282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1069/2136] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:49 2022] DELETE /identity/v3/users/97f2d2127edb43928869ef0c35af070d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:49.965143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.965582 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.965894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.972571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:49.972964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:49.973732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:49.992900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:49.994118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.005894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] MFA Rules not processed for user `b7b34a80131a4a008afc1aa1951a36f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:50.016338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.061749 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1068/2137] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:50.064911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:50.064911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.075425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f754c-a6c4-4b4b-98b6-86db7ed4f9ae None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:50.080168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:50.081023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:50.081305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:50.081582 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] PATH_INFO: `/v3/users/787eb04947a74a8caea2aff696ea810f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:50.082786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] RBAC: Authorizing `identity:delete_user(user_id=787eb04947a74a8caea2aff696ea810f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:50.084783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:50.092252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1070/2138] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:50.093289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:50.094747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.135835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787eb04947a74a8caea2aff696ea810f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:50.144015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787eb04947a74a8caea2aff696ea810f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:50.151147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787eb04947a74a8caea2aff696ea810f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:50.152156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13937d67-359e-4a53-bc19-861bfcf9559b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:50.156711 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02862-e105-4ee1-8346-4d22e5a6cf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:50.157359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02862-e105-4ee1-8346-4d22e5a6cf52 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:50.157663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02862-e105-4ee1-8346-4d22e5a6cf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:50.157930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02862-e105-4ee1-8346-4d22e5a6cf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:50.164070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787eb04947a74a8caea2aff696ea810f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:50.164762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787eb04947a74a8caea2aff696ea810f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:50.167262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02862-e105-4ee1-8346-4d22e5a6cf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:50.169552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02862-e105-4ee1-8346-4d22e5a6cf52 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:50.171185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1069/2139] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:50 2022] DELETE /identity/v3/users/787eb04947a74a8caea2aff696ea810f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:50.175886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:50.176256 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.182181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1071/2140] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:50.183482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:50.183813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:50.184112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:50.202008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:50.203619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.248392 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23de1b-cd5b-4713-8708-c8f2701d143d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:50.252425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:50.253121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:50.253449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:50.253770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:50.255760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.275318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1072/2141] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:50.285710 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:50.287293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.327341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:50.328909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:50.339121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1070/2142] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:50.350615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420fc6-d93e-48aa-be25-c6fe17649a8a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:50.354400 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:50.355047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:50.355330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:50.356201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:50.365899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:50.367360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:50.377263 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1073/2143] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:50.889734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:50.891249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:50.905438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6135d-2c11-4f42-b96c-3d0280914852 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:50.910217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:50.911859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:50.911859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:50.911859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] PATH_INFO: `/v3/projects/56715da73513460c9d99c088b881e193` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:50.917751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] RBAC: Authorizing `identity:delete_project(project_id=56715da73513460c9d99c088b881e193)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:50.917751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:50.969694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56715da73513460c9d99c088b881e193', 'request_id': 'req-d40a064c-2f75-488e-821e-7df9a918ecda'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:50.977776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56715da73513460c9d99c088b881e193', 'request_id': 'req-d40a064c-2f75-488e-821e-7df9a918ecda'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:50.984211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56715da73513460c9d99c088b881e193', 'request_id': 'req-d40a064c-2f75-488e-821e-7df9a918ecda'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.002084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] The token cache is being invalidate because project 56715da73513460c9d99c088b881e193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:51.002518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.003916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.006366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1071/2144] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:50 2022] DELETE /identity/v3/projects/56715da73513460c9d99c088b881e193 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:51.009815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:51.020365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897d4bc-6d8d-411a-a1d4-35b4af34429d service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:51.117865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:51.118747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.119221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.119664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] PATH_INFO: `/v3/users/e2b04bdde1854f2f8153331888f5217f` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.120835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b04bdde1854f2f8153331888f5217f)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:51.122865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:51.123253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:51.124678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:51.141419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a064c-2f75-488e-821e-7df9a918ecda admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:51.146737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:51.147635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.147922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.148202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] PATH_INFO: `/v3/projects/d116a4775cc34bb1ab60141f58d0f62a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.150967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d116a4775cc34bb1ab60141f58d0f62a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:51.154074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:51.193468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b04bdde1854f2f8153331888f5217f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.203560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b04bdde1854f2f8153331888f5217f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.217331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b04bdde1854f2f8153331888f5217f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.227874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b04bdde1854f2f8153331888f5217f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.228703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1c839cd3-5667-46d6-bb71-eaf78731ff39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b04bdde1854f2f8153331888f5217f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.229456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd116a4775cc34bb1ab60141f58d0f62a', 'request_id': 'req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.240474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1074/2145] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:51 2022] DELETE /identity/v3/users/e2b04bdde1854f2f8153331888f5217f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:51.244323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd116a4775cc34bb1ab60141f58d0f62a', 'request_id': 'req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.252672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd116a4775cc34bb1ab60141f58d0f62a', 'request_id': 'req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.287541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] The token cache is being invalidate because project d116a4775cc34bb1ab60141f58d0f62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:51.288250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.289185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3adbb1ef-0e3f-4a41-916a-af5f05cf725b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.296230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1072/2146] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:51 2022] DELETE /identity/v3/projects/d116a4775cc34bb1ab60141f58d0f62a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:51.299008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4fa0-32f5-434a-89c5-c3347815fd36 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.299524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4fa0-32f5-434a-89c5-c3347815fd36 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.300000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4fa0-32f5-434a-89c5-c3347815fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.322241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-831f4fa0-32f5-434a-89c5-c3347815fd36 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:51.323521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-831f4fa0-32f5-434a-89c5-c3347815fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:51.428422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1075/2147] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:51.441784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d36934-cff2-4115-8385-315ff2cb61fb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.442151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d36934-cff2-4115-8385-315ff2cb61fb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.442345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d36934-cff2-4115-8385-315ff2cb61fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.464076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d3d36934-cff2-4115-8385-315ff2cb61fb None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:51.465562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d3d36934-cff2-4115-8385-315ff2cb61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:51.479090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1073/2148] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:51.481116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4fa0-32f5-434a-89c5-c3347815fd36 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:51.493390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4fa0-32f5-434a-89c5-c3347815fd36 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:51.499308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:51.500017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.500306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.500593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.501384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:51.502387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:51.519112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:51.543297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1076/2149] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:36:51.545210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d36934-cff2-4115-8385-315ff2cb61fb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:51.555093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d36934-cff2-4115-8385-315ff2cb61fb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:51.575696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:51.576723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.577013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.577296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.578101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:51.580336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:51.615229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:51.617608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:51.652598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1074/2150] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:51 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:51.657526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:51.673734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401d7f-c356-415b-8cf5-43a45fbfca11 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:51.771221 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:51.772299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.772600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.773157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] PATH_INFO: `/v3/projects/8c21893ca158456b987907e73798f17a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.773869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccf79d-078d-43a0-895e-a042f2c49359 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:51.774417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c21893ca158456b987907e73798f17a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:51.777562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:51.778936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:51.779905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.780195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.780701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.781745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:51.783744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:51.834281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1075/2151] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:51 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:51.834281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:51.855613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c21893ca158456b987907e73798f17a', 'request_id': 'req-e64a75e8-5555-4cb3-b3e5-51ee41357a83'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.857779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1e45c-3099-48fd-a8b3-d5c77f4f3d57 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:51.866291 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c21893ca158456b987907e73798f17a', 'request_id': 'req-e64a75e8-5555-4cb3-b3e5-51ee41357a83'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.882935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c21893ca158456b987907e73798f17a', 'request_id': 'req-e64a75e8-5555-4cb3-b3e5-51ee41357a83'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.914101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] The token cache is being invalidate because project 8c21893ca158456b987907e73798f17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:36:51.914763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.916089 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e64a75e8-5555-4cb3-b3e5-51ee41357a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:51.919858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1077/2152] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:51 2022] DELETE /identity/v3/projects/8c21893ca158456b987907e73798f17a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:51.927998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.928306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.928570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.962327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:51.963963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:51.970118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4479e4-e29d-4bfd-a1a8-24d8f9426a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:51.970805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4479e4-e29d-4bfd-a1a8-24d8f9426a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.971087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4479e4-e29d-4bfd-a1a8-24d8f9426a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.971360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4479e4-e29d-4bfd-a1a8-24d8f9426a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.972143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4479e4-e29d-4bfd-a1a8-24d8f9426a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:51.973737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4479e4-e29d-4bfd-a1a8-24d8f9426a8a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:51.989141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1076/2153] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:51.991069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9b3b-b7d6-4a50-a664-ac7a173338dd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:51.991843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9b3b-b7d6-4a50-a664-ac7a173338dd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:51.992483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d9b3b-b7d6-4a50-a664-ac7a173338dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:51.993513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1078/2154] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:51.998727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.000097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:52.014796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3d6d9b3b-b7d6-4a50-a664-ac7a173338dd None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:52.016318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3d6d9b3b-b7d6-4a50-a664-ac7a173338dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:52.030420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1077/2155] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:52.034129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9b3b-b7d6-4a50-a664-ac7a173338dd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.034281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f0fed-9fdc-4342-82b4-934d02e0b817 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.041696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d9b3b-b7d6-4a50-a664-ac7a173338dd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.048420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.048876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.049172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.049416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.050773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.055529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.055793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.056005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.056309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.056620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.057363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:36:52.057694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.059587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.067440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1079/2156] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:52.071766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.085478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1078/2157] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:36:52.089416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.112883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28dd63-39c7-4cef-b099-7ec4e4be4aef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.113947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1864ad-c29d-42b4-a074-2a3798b943c2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.126949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.127661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.127948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.128248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.128962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.129948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96577a3-60b5-4997-9f5f-7e9a3cdef649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.130889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.133204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96577a3-60b5-4997-9f5f-7e9a3cdef649 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.133598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96577a3-60b5-4997-9f5f-7e9a3cdef649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.134548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96577a3-60b5-4997-9f5f-7e9a3cdef649 admin admin] PATH_INFO: `/v3/projects/6a6c56ea45364186949fbe8fe401a723/users/cb75ef23d08b41d28f7ef01f847125ab/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.174303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96577a3-60b5-4997-9f5f-7e9a3cdef649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6c56ea45364186949fbe8fe401a723, user_id=cb75ef23d08b41d28f7ef01f847125ab, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.178063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96577a3-60b5-4997-9f5f-7e9a3cdef649 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.192006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1079/2158] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:52 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:52.196365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.204074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1080/2159] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:52 2022] PUT /identity/v3/projects/6a6c56ea45364186949fbe8fe401a723/users/cb75ef23d08b41d28f7ef01f847125ab/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:52.215185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.215497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.215785 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.256870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] MFA Rules not processed for user `cb75ef23d08b41d28f7ef01f847125ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:52.258392 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:52.294292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208bff-4e1c-493c-b065-fd2dd2f60de1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.348479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1081/2160] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:36:52.362209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.364167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:52.364595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.365601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.365977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.367015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.367907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.369931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.399898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1080/2161] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:52 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:52.404963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.427828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba7921-8c64-42da-89f8-c9b7710c46d5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.435979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.436788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.437176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.438078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.438953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.441027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.456118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda081-189a-4c00-a273-7d63158113f7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.461656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1081/2162] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:52.463775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fa61e-daeb-420a-b284-9c3559dfdd86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.466021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.466195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa61e-daeb-420a-b284-9c3559dfdd86 service glance] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.466805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa61e-daeb-420a-b284-9c3559dfdd86 service glance] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.467611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa61e-daeb-420a-b284-9c3559dfdd86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.476969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b271644-0ce2-4bbf-9997-883ff01ae679 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.481237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fa61e-daeb-420a-b284-9c3559dfdd86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.483909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.485477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.485785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.486290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.487338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.489546 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.490485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fa61e-daeb-420a-b284-9c3559dfdd86 service glance] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.500750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1082/2163] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:36:52.504775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.507560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1082/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:36:52.514613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e548-6f84-4fa8-b53b-355c99c4ab82 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.519975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.520594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.520882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.521161 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] PATH_INFO: `/v3/projects/01b9556f6bcf4a6fb3544a1bae0910ae/users/11e71f49d7b145b497f1e4ca4aef65e7/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.537372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b9556f6bcf4a6fb3544a1bae0910ae, user_id=11e71f49d7b145b497f1e4ca4aef65e7, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.540218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.558133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1083/2165] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:52 2022] PUT /identity/v3/projects/01b9556f6bcf4a6fb3544a1bae0910ae/users/11e71f49d7b145b497f1e4ca4aef65e7/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:52.568530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9fdd-afc5-40e1-aae4-3ba8b2d7e913 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.568852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9fdd-afc5-40e1-aae4-3ba8b2d7e913 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.569098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9fdd-afc5-40e1-aae4-3ba8b2d7e913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.596259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-525e9fdd-afc5-40e1-aae4-3ba8b2d7e913 None None] MFA Rules not processed for user `11e71f49d7b145b497f1e4ca4aef65e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:52.597596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-525e9fdd-afc5-40e1-aae4-3ba8b2d7e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:52.665948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1083/2166] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:52.670912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.739593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee453a9-44f2-49a0-810d-d8760352c32e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.744932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.745615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.745906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.746825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.747582 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.749543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.775927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1084/2167] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:36:52 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:52.780477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e9fdd-afc5-40e1-aae4-3ba8b2d7e913 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.791865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e9fdd-afc5-40e1-aae4-3ba8b2d7e913 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.858819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.859586 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.859866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.860143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.860930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.863155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.887866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1084/2168] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:36:52 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:36:52.889419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.901475 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73fd25-d36c-4b90-b654-719e9de73bc1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.911332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.912146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.912528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.912887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.913888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.916076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:52.927813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1085/2169] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:52.932009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:52.963601 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52270ade-3d28-48c3-af1a-977b8a9fd781 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:52.969634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:52.970526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:52.970812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:52.971315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] PATH_INFO: `/v3/projects/a7fb9bee4e184a419c5a4f61b39ebd6c/users/93a09c1b853d4acea66c5d0f6f816f80/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:52.991512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fb9bee4e184a419c5a4f61b39ebd6c, user_id=93a09c1b853d4acea66c5d0f6f816f80, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:52.994511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:53.023016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1085/2170] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:52 2022] PUT /identity/v3/projects/a7fb9bee4e184a419c5a4f61b39ebd6c/users/93a09c1b853d4acea66c5d0f6f816f80/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:36:53.027095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:53.039060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec7df0-fc38-4b2d-827e-dd7bc2b60e5d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:53.102576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12251c-3166-4625-bedc-10e69be8d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:53.103232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12251c-3166-4625-bedc-10e69be8d73a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:53.103556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12251c-3166-4625-bedc-10e69be8d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:53.103841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12251c-3166-4625-bedc-10e69be8d73a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:53.104591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12251c-3166-4625-bedc-10e69be8d73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:53.106869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12251c-3166-4625-bedc-10e69be8d73a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:53.118179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1086/2171] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:36:53.122135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:53.133864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6281d-7a1d-43e8-9fff-b0b919ff74cc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:53.138768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:53.139813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:53.140496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:53.140496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] PATH_INFO: `/v3/projects/a7fb9bee4e184a419c5a4f61b39ebd6c/users/93a09c1b853d4acea66c5d0f6f816f80/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:53.142355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fb9bee4e184a419c5a4f61b39ebd6c, user_id=93a09c1b853d4acea66c5d0f6f816f80, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:53.145014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:53.156140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1086/2172] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:36:53 2022] PUT /identity/v3/projects/a7fb9bee4e184a419c5a4f61b39ebd6c/users/93a09c1b853d4acea66c5d0f6f816f80/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:53.167189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da2c06-f208-4e5c-9c33-37074698418f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:53.167288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da2c06-f208-4e5c-9c33-37074698418f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:53.167641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da2c06-f208-4e5c-9c33-37074698418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:53.195497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d5da2c06-f208-4e5c-9c33-37074698418f None None] MFA Rules not processed for user `93a09c1b853d4acea66c5d0f6f816f80`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:53.196740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d5da2c06-f208-4e5c-9c33-37074698418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:53.262790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1087/2173] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:53.272010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:53.273727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:53.330083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d73dee-e86b-4ef1-940e-952228aa982d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:53.333731 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:53.334373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:53.334656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:53.334934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:53.389783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:53.391232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:53.400271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1087/2174] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:57.985676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:57.986172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:57.986365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:58.003525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] MFA Rules not processed for user `93bd2a35edc74582b837a2e76b92bc93`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:58.004714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:58.057345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1088/2175] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:58.703752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:58.712430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d9db6-cfe5-490c-b11e-9c8a547c126e service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:58.716924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c5602-45fc-450e-a171-1c7521e76e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:58.717565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5602-45fc-450e-a171-1c7521e76e90 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:58.717849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5602-45fc-450e-a171-1c7521e76e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:58.718131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c5602-45fc-450e-a171-1c7521e76e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:58.727870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c5602-45fc-450e-a171-1c7521e76e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:58.729337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c5602-45fc-450e-a171-1c7521e76e90 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:58.739563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1088/2176] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:58.957919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:58.959364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:59.086663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d42680-a30b-4663-b6b0-52b191e67811 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:59.115617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:59.122897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:59.123192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:59.123501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] PATH_INFO: `/v3/users/b7b34a80131a4a008afc1aa1951a36f6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:59.126945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b34a80131a4a008afc1aa1951a36f6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:59.130899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:59.217759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b34a80131a4a008afc1aa1951a36f6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:59.226776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b34a80131a4a008afc1aa1951a36f6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:59.236560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b34a80131a4a008afc1aa1951a36f6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:59.250809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b34a80131a4a008afc1aa1951a36f6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:59.251664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b34a80131a4a008afc1aa1951a36f6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:36:59.262213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1089/2177] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:36:58 2022] DELETE /identity/v3/users/b7b34a80131a4a008afc1aa1951a36f6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:36:59.268328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade73a75-d884-4223-acb5-298444011ffc None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:59.268623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade73a75-d884-4223-acb5-298444011ffc None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:59.270312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade73a75-d884-4223-acb5-298444011ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:59.310736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ade73a75-d884-4223-acb5-298444011ffc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:36:59.315099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ade73a75-d884-4223-acb5-298444011ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:59.400547 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1089/2178] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:36:59.410413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:59.411978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:59.471158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102fc3c-5b85-43ff-8cca-f3f92393cd20 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:59.475566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50d9ce-9b66-4e20-9c49-ea04aa3a684c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:59.476232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50d9ce-9b66-4e20-9c49-ea04aa3a684c service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:59.476516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50d9ce-9b66-4e20-9c49-ea04aa3a684c service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:59.476792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50d9ce-9b66-4e20-9c49-ea04aa3a684c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:59.487713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50d9ce-9b66-4e20-9c49-ea04aa3a684c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:59.489153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50d9ce-9b66-4e20-9c49-ea04aa3a684c service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:36:59.501037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1090/2179] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:36:59.928780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade73a75-d884-4223-acb5-298444011ffc None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:36:59.930762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ade73a75-d884-4223-acb5-298444011ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:36:59.972157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade73a75-d884-4223-acb5-298444011ffc None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:36:59.986606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:36:59.987874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:36:59.988156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:36:59.988432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] PATH_INFO: `/v3/projects/9a9169a0cb4e4153a97df4d7199d7916` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:36:59.989721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9169a0cb4e4153a97df4d7199d7916)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:36:59.992108 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.049822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9169a0cb4e4153a97df4d7199d7916', 'request_id': 'req-11861cb0-c4f2-4860-b7ee-d284e35b6718'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:00.056245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9169a0cb4e4153a97df4d7199d7916', 'request_id': 'req-11861cb0-c4f2-4860-b7ee-d284e35b6718'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:00.063989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9169a0cb4e4153a97df4d7199d7916', 'request_id': 'req-11861cb0-c4f2-4860-b7ee-d284e35b6718'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:00.080101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] The token cache is being invalidate because project 9a9169a0cb4e4153a97df4d7199d7916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:00.081021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:00.081801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11861cb0-c4f2-4860-b7ee-d284e35b6718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:00.083556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1090/2180] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:36:59 2022] DELETE /identity/v3/projects/9a9169a0cb4e4153a97df4d7199d7916 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:00.089388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca24b-05e3-49f6-afe2-3b480d69b20d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.089827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca24b-05e3-49f6-afe2-3b480d69b20d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.090055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca24b-05e3-49f6-afe2-3b480d69b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.107556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3eeca24b-05e3-49f6-afe2-3b480d69b20d None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:00.108758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3eeca24b-05e3-49f6-afe2-3b480d69b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:00.178538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1091/2181] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:00.187349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a7b1b-c232-4527-b77e-47e313718ebc None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.187778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a7b1b-c232-4527-b77e-47e313718ebc None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.188162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a7b1b-c232-4527-b77e-47e313718ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.206655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-bb6a7b1b-c232-4527-b77e-47e313718ebc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:00.208150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-bb6a7b1b-c232-4527-b77e-47e313718ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:00.216979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1091/2182] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:00.221347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca24b-05e3-49f6-afe2-3b480d69b20d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:00.237030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca24b-05e3-49f6-afe2-3b480d69b20d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:00.242607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:00.243570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.243928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.244280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.245101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:00.245481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:00.247364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.259489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1092/2183] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:00.264299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a7b1b-c232-4527-b77e-47e313718ebc None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:00.275834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a7b1b-c232-4527-b77e-47e313718ebc None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:00.282122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:00.282793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.283080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.283367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.284433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:00.286367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.317407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1092/2184] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:00 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:00.321529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:00.335454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c607b-8ba6-4ed5-82e5-b7a4baea5614 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:00.433857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:00.434798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.435086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.435367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.436141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:00.438336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.472209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1093/2185] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:00 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:00.473690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:00.486408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b481f-101e-4325-bbed-eef8bb05691e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:00.492033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:00.492991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.493970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.493970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.494455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:00.496416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.508267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1093/2186] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:00.515232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:00.528612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc3c1-7671-4718-9698-d47bd6df6f56 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:00.535000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e4312-44d1-4377-9569-18678193dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:00.535868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e4312-44d1-4377-9569-18678193dfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.536225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e4312-44d1-4377-9569-18678193dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.536578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e4312-44d1-4377-9569-18678193dfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.537414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e4312-44d1-4377-9569-18678193dfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:00.539312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e4312-44d1-4377-9569-18678193dfd6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.550490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1094/2187] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:00.554973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:00.566502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b4cd-ca61-4d19-a025-0108e34bc133 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:00.572558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:00.573599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.573897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.574228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] PATH_INFO: `/v3/projects/90e640c4bb6a4704b5df1eac7b0c593d/users/bfe6ff9d40df4ddab2429bb25c0a4c4f/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.591126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e640c4bb6a4704b5df1eac7b0c593d, user_id=bfe6ff9d40df4ddab2429bb25c0a4c4f, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:00.594286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.612350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1094/2188] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:00 2022] PUT /identity/v3/projects/90e640c4bb6a4704b5df1eac7b0c593d/users/bfe6ff9d40df4ddab2429bb25c0a4c4f/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:00.623204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.623662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.623953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.666712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] MFA Rules not processed for user `bfe6ff9d40df4ddab2429bb25c0a4c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:00.669780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:00.771359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1095/2189] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:00.782875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:00.784874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:00.864412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f76d9-3b3f-4116-b0af-ed36a3ffb48c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:00.868041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1accf-f861-4f0b-b3c3-cb3477c74e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:00.868721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1accf-f861-4f0b-b3c3-cb3477c74e32 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:00.869053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1accf-f861-4f0b-b3c3-cb3477c74e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:00.869340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1accf-f861-4f0b-b3c3-cb3477c74e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:00.879736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1accf-f861-4f0b-b3c3-cb3477c74e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:00.881202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1accf-f861-4f0b-b3c3-cb3477c74e32 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:00.902720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1095/2190] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:03.759541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:03.761021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:03.826945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c516a-56b8-4c38-b97c-a8779d6f045f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:03.831855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:03.832897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:03.833260 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:03.833563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] PATH_INFO: `/v3/users/11e71f49d7b145b497f1e4ca4aef65e7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:03.834920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e71f49d7b145b497f1e4ca4aef65e7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:03.836854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:03.886854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e71f49d7b145b497f1e4ca4aef65e7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:03.894151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e71f49d7b145b497f1e4ca4aef65e7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:03.901246 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e71f49d7b145b497f1e4ca4aef65e7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:03.913599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e71f49d7b145b497f1e4ca4aef65e7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:03.914292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e71f49d7b145b497f1e4ca4aef65e7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:03.920721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1096/2191] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:03 2022] DELETE /identity/v3/users/11e71f49d7b145b497f1e4ca4aef65e7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:03.925206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:03.926090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:03.926375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:03.945151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:03.946339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:04.007520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1096/2192] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:04.014608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:04.017784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:04.072375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:04.075828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:04.095645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f29b-738d-45a5-a9ac-c6613308bbe7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:04.096309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87e643-4065-4df5-9af4-b96f78392a5a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:04.099721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75158e-bf51-4ba7-b6df-80babfc9f3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:04.100747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75158e-bf51-4ba7-b6df-80babfc9f3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.101048 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75158e-bf51-4ba7-b6df-80babfc9f3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.101412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75158e-bf51-4ba7-b6df-80babfc9f3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.102665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:04.103984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.104474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.105442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] PATH_INFO: `/v3/users/bfe6ff9d40df4ddab2429bb25c0a4c4f` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.106878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe6ff9d40df4ddab2429bb25c0a4c4f)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:04.109077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:04.116814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75158e-bf51-4ba7-b6df-80babfc9f3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:04.121855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75158e-bf51-4ba7-b6df-80babfc9f3d3 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:04.132468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1097/2193] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:04.197203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe6ff9d40df4ddab2429bb25c0a4c4f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.214960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe6ff9d40df4ddab2429bb25c0a4c4f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.239006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe6ff9d40df4ddab2429bb25c0a4c4f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.260719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe6ff9d40df4ddab2429bb25c0a4c4f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.261467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe6ff9d40df4ddab2429bb25c0a4c4f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.272065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1097/2194] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:04 2022] DELETE /identity/v3/users/bfe6ff9d40df4ddab2429bb25c0a4c4f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:04.273658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.273995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.274322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.300988 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:04.302400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:04.402228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1098/2195] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:04.415560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:04.415560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:04.487849 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f0f0-cac8-475b-a233-4f17467c9446 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:04.495039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:04.495759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.496041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.496317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.506717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:04.507763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:04.518780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1098/2196] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:04.562969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:04.564803 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:04.577336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddb0e7-d09a-450f-ac1d-c5e1aafd2777 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:04.585695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:04.586305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.586305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.586497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] PATH_INFO: `/v3/projects/01b9556f6bcf4a6fb3544a1bae0910ae` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.587805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b9556f6bcf4a6fb3544a1bae0910ae)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:04.590493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:04.645039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b9556f6bcf4a6fb3544a1bae0910ae', 'request_id': 'req-c8f67415-59fe-48d1-85d6-e849b5ed918a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.654095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b9556f6bcf4a6fb3544a1bae0910ae', 'request_id': 'req-c8f67415-59fe-48d1-85d6-e849b5ed918a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.662565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b9556f6bcf4a6fb3544a1bae0910ae', 'request_id': 'req-c8f67415-59fe-48d1-85d6-e849b5ed918a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.678385 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] The token cache is being invalidate because project 01b9556f6bcf4a6fb3544a1bae0910ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:04.678699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.681884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.681884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1099/2197] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:04 2022] DELETE /identity/v3/projects/01b9556f6bcf4a6fb3544a1bae0910ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:04.686408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:04.700459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410d50f-9b54-46c1-8d58-f29f53d495fa service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:04.764875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:04.765851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.766129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.766407 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] PATH_INFO: `/v3/users/93a09c1b853d4acea66c5d0f6f816f80` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.768162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a09c1b853d4acea66c5d0f6f816f80)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:04.770406 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:04.827618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:04.828954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a09c1b853d4acea66c5d0f6f816f80'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.829267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:04.837825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a09c1b853d4acea66c5d0f6f816f80'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.843979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f67415-59fe-48d1-85d6-e849b5ed918a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:04.848931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:04.851024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.851308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.851619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] PATH_INFO: `/v3/projects/90e640c4bb6a4704b5df1eac7b0c593d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.852871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e640c4bb6a4704b5df1eac7b0c593d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:04.855063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:04.864897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a09c1b853d4acea66c5d0f6f816f80'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.879142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a09c1b853d4acea66c5d0f6f816f80'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.879882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-544f18bd-2942-49e8-af54-124681bbf39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a09c1b853d4acea66c5d0f6f816f80'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.887518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1099/2198] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:04 2022] DELETE /identity/v3/users/93a09c1b853d4acea66c5d0f6f816f80 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:04.914989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e640c4bb6a4704b5df1eac7b0c593d', 'request_id': 'req-247a5b2b-9a89-4c37-8522-bc8578d076b2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.924590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e640c4bb6a4704b5df1eac7b0c593d', 'request_id': 'req-247a5b2b-9a89-4c37-8522-bc8578d076b2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.935524 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e640c4bb6a4704b5df1eac7b0c593d', 'request_id': 'req-247a5b2b-9a89-4c37-8522-bc8578d076b2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.951697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] The token cache is being invalidate because project 90e640c4bb6a4704b5df1eac7b0c593d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:04.952319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.953397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-247a5b2b-9a89-4c37-8522-bc8578d076b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:04.956118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1100/2199] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:04 2022] DELETE /identity/v3/projects/90e640c4bb6a4704b5df1eac7b0c593d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:04.962545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19f0d-59cd-4117-b444-6f349a016e6b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:04.963091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19f0d-59cd-4117-b444-6f349a016e6b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:04.963091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19f0d-59cd-4117-b444-6f349a016e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:04.982648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-afc19f0d-59cd-4117-b444-6f349a016e6b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:04.984193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-afc19f0d-59cd-4117-b444-6f349a016e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:05.050107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1100/2200] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:05.053958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26c8d-90c7-4114-b171-1004469c9f76 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.054266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26c8d-90c7-4114-b171-1004469c9f76 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.054543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26c8d-90c7-4114-b171-1004469c9f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.073574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cbf26c8d-90c7-4114-b171-1004469c9f76 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:05.074884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cbf26c8d-90c7-4114-b171-1004469c9f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:05.083086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1101/2201] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:05.087600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19f0d-59cd-4117-b444-6f349a016e6b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.097696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19f0d-59cd-4117-b444-6f349a016e6b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.102318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.102910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.103191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.103504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.104237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:05.104545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.106247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.117794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1101/2202] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:05.122590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf26c8d-90c7-4114-b171-1004469c9f76 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.133180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf26c8d-90c7-4114-b171-1004469c9f76 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.138131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.138799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.139085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.139364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.140119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.142020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.169193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.172595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1102/2203] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:05.172743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:05.175438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.197309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bfcee-a431-4716-b51f-c2c6cbb3557f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.247365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c51228-b20e-4a4a-82e3-728b54e086a8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.252247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.252922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.253207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.253489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.254205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.254800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.255687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.255969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.256193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.256318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] PATH_INFO: `/v3/projects/a7fb9bee4e184a419c5a4f61b39ebd6c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.257427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fb9bee4e184a419c5a4f61b39ebd6c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.259529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.277845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1103/2204] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:05.282365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.293970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c0f4-50a0-4935-a1c3-1997a6ea47e9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.299648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.300557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.300930 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.301337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.302253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.304177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.312111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fb9bee4e184a419c5a4f61b39ebd6c', 'request_id': 'req-0fe7653f-99db-4891-a207-831e7f30418e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:05.317873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1104/2205] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:37:05.318881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fb9bee4e184a419c5a4f61b39ebd6c', 'request_id': 'req-0fe7653f-99db-4891-a207-831e7f30418e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:05.319231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.324618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fb9bee4e184a419c5a4f61b39ebd6c', 'request_id': 'req-0fe7653f-99db-4891-a207-831e7f30418e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:05.329748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913fd6b-a6cd-4ea6-a04a-156c3298a2b5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.337519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] The token cache is being invalidate because project a7fb9bee4e184a419c5a4f61b39ebd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:05.337807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:05.338553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-0fe7653f-99db-4891-a207-831e7f30418e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:05.341101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1102/2206] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:05 2022] DELETE /identity/v3/projects/a7fb9bee4e184a419c5a4f61b39ebd6c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:05.348104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171d576-4415-4520-bfb4-f409a6f113bd None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.348397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171d576-4415-4520-bfb4-f409a6f113bd None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.348681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171d576-4415-4520-bfb4-f409a6f113bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.376797 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c171d576-4415-4520-bfb4-f409a6f113bd None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:05.378699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c171d576-4415-4520-bfb4-f409a6f113bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:05.420069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.421594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.423316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.423316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.423316 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.435857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.470233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1105/2207] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:37:05.485705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.485919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1103/2208] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:05.486016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:05.490575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d84ef5-92b2-4d48-8a53-8250f9f6ec81 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.490865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d84ef5-92b2-4d48-8a53-8250f9f6ec81 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.491142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d84ef5-92b2-4d48-8a53-8250f9f6ec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.501319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e6b7a-837f-4cbd-8684-c9c616005a99 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.511523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c49366-2a8f-4330-8b48-65473efa8364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.511523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49366-2a8f-4330-8b48-65473efa8364 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.511523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49366-2a8f-4330-8b48-65473efa8364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.511523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49366-2a8f-4330-8b48-65473efa8364 admin admin] PATH_INFO: `/v3/projects/8aebfd77edf24ebea6522ea744ea5503/users/daf567815b4b4131a66a59b03164577c/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.523975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-50d84ef5-92b2-4d48-8a53-8250f9f6ec81 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:05.526125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-50d84ef5-92b2-4d48-8a53-8250f9f6ec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:05.535851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c49366-2a8f-4330-8b48-65473efa8364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aebfd77edf24ebea6522ea744ea5503, user_id=daf567815b4b4131a66a59b03164577c, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.536836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1104/2209] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:05.540877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d84ef5-92b2-4d48-8a53-8250f9f6ec81 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.544120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c49366-2a8f-4330-8b48-65473efa8364 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.552887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d84ef5-92b2-4d48-8a53-8250f9f6ec81 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.558879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.559956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.560770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.561257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.562329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:05.562642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1106/2210] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:05 2022] PUT /identity/v3/projects/8aebfd77edf24ebea6522ea744ea5503/users/daf567815b4b4131a66a59b03164577c/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:05.563159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.564858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.574052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df57a-6b0c-4288-9e73-1905aaf9449e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.574463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df57a-6b0c-4288-9e73-1905aaf9449e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.575279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df57a-6b0c-4288-9e73-1905aaf9449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.589675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1105/2211] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:05.589675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.604007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d3d74-cf84-4e1e-a87a-fc30d0f5b9a0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.614687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-518df57a-6b0c-4288-9e73-1905aaf9449e None None] MFA Rules not processed for user `daf567815b4b4131a66a59b03164577c`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:05.615948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-518df57a-6b0c-4288-9e73-1905aaf9449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:05.692246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.692921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.693235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.693517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.694243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.696540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.710377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1107/2212] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:05.715822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df57a-6b0c-4288-9e73-1905aaf9449e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.726790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df57a-6b0c-4288-9e73-1905aaf9449e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.733111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.734062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.734572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.734986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.736551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.740170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.746035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1106/2213] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:05.752177 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.772573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1108/2214] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:05.776837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.835709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4c9e-1239-460a-8c6b-239ac8c16939 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.878679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e03ee-c89a-437a-a5b7-5d7dba2b6868 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.897128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.897898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.898185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.898470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.899646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.901666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.932086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.932787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.933588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.933893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.934626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.935584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1109/2215] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:05.936967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.939639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.954407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0c134-17dc-453b-a322-71eee87fb67e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:05.970932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:05.972096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:05.972393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:05.972694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:05.973450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:05.975105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:05.979866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1107/2216] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:05 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:05.985799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1110/2217] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:37:05.992489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:05.992701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.004405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334de1-e7bd-405e-8fca-46fd750a169f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.010588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.012299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.012431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a66c4-ec70-4c0e-8a5e-813b95200f47 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.012672 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.012963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.013913 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.015656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.018179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.018953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.019274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.019622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.020465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.028420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.028646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1108/2218] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:06.032511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.043191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef226-1de2-4006-8d1a-dc4b319f6b65 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.043705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1111/2219] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:06.048564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.053572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.054312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.054683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.054979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.055779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.057606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.062487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6299-4666-4b90-b48f-9f3494d2a4b3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.068011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4fe3b-0d48-4545-8cee-ca09f5ec84f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.069184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4fe3b-0d48-4545-8cee-ca09f5ec84f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.069327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1109/2220] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:37:06.069432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4fe3b-0d48-4545-8cee-ca09f5ec84f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.069611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4fe3b-0d48-4545-8cee-ca09f5ec84f9 admin admin] PATH_INFO: `/v3/projects/2c1693a4fe8146e6b5f3b8f4fa7861c2/users/5e22771d85224a49a23404c2310df2c6/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.073056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.085006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43652c86-15b1-4956-80c2-85920670202c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.087902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4fe3b-0d48-4545-8cee-ca09f5ec84f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1693a4fe8146e6b5f3b8f4fa7861c2, user_id=5e22771d85224a49a23404c2310df2c6, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.094491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4fe3b-0d48-4545-8cee-ca09f5ec84f9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.094699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056271a6-c69d-4c80-9a0a-f19fc8acae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.094699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056271a6-c69d-4c80-9a0a-f19fc8acae45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.094699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056271a6-c69d-4c80-9a0a-f19fc8acae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.094699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056271a6-c69d-4c80-9a0a-f19fc8acae45 admin admin] PATH_INFO: `/v3/projects/742fc449b8754c1f9229122a1915a722/users/9d4aac5f78764adfab73065e03f6473e/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.110405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1112/2221] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:06 2022] PUT /identity/v3/projects/2c1693a4fe8146e6b5f3b8f4fa7861c2/users/5e22771d85224a49a23404c2310df2c6/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:06.117805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056271a6-c69d-4c80-9a0a-f19fc8acae45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742fc449b8754c1f9229122a1915a722, user_id=9d4aac5f78764adfab73065e03f6473e, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.121497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056271a6-c69d-4c80-9a0a-f19fc8acae45 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.121837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448880d-c88f-40b2-80b4-c8ff4f418b82 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.122348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448880d-c88f-40b2-80b4-c8ff4f418b82 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.122828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448880d-c88f-40b2-80b4-c8ff4f418b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.139427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1110/2222] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:06 2022] PUT /identity/v3/projects/742fc449b8754c1f9229122a1915a722/users/9d4aac5f78764adfab73065e03f6473e/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:06.149586 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.149814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.150117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.160940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3448880d-c88f-40b2-80b4-c8ff4f418b82 None None] MFA Rules not processed for user `5e22771d85224a49a23404c2310df2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:06.162163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3448880d-c88f-40b2-80b4-c8ff4f418b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.179515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] MFA Rules not processed for user `9d4aac5f78764adfab73065e03f6473e`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:06.180749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.238200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1113/2223] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:06.242800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448880d-c88f-40b2-80b4-c8ff4f418b82 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.250134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1111/2224] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:06.259862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.261193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.307595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448880d-c88f-40b2-80b4-c8ff4f418b82 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.312941 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.313597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.313877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.314152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.314852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.316796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.320031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688873f7-5119-4641-9783-315bd32be6a9 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.323753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.324401 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.324688 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.324969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.333399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.334897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.341887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1114/2225] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:06 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:06.345656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1112/2226] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:06.345847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.365714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.377008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d6dc-5560-476b-9526-654acb42a61b service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.408835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07440188-29ea-4d95-84c5-f2cc819cf8cb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.413931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.414602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.414890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.415192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.415948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.418504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.430459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.431575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.431927 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.432305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] PATH_INFO: `/v3/users/9d4aac5f78764adfab73065e03f6473e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.434310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4aac5f78764adfab73065e03f6473e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.436500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.441186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1115/2227] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:06 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:06.445227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.455061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72869e26-6656-47a9-9c0c-1a02dd8f1c18 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.460061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.460826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.461172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.461487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.462336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.464369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.475146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1116/2228] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:06.479166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.484597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4aac5f78764adfab73065e03f6473e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:06.489861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7153c29-48a1-40f4-98e8-0edac183176d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.495992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.496834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.497120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.497408 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] PATH_INFO: `/v3/projects/d37fdd7be08943078e3c7a7468584e62/users/c16d98c4f73a40a09474df6ba9832ab7/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.500844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4aac5f78764adfab73065e03f6473e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:06.513395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4aac5f78764adfab73065e03f6473e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:06.517729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37fdd7be08943078e3c7a7468584e62, user_id=c16d98c4f73a40a09474df6ba9832ab7, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.521337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.524155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4aac5f78764adfab73065e03f6473e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:06.524922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-05616cd9-4d2b-49c0-908d-0b059c67fc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4aac5f78764adfab73065e03f6473e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:06.532163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1113/2229] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:06 2022] DELETE /identity/v3/users/9d4aac5f78764adfab73065e03f6473e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:06.536724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dc547-082d-461a-b200-80e50f521530 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.537134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dc547-082d-461a-b200-80e50f521530 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.537470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dc547-082d-461a-b200-80e50f521530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.537574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1117/2230] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:06 2022] PUT /identity/v3/projects/d37fdd7be08943078e3c7a7468584e62/users/c16d98c4f73a40a09474df6ba9832ab7/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:06.541405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.543734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.557065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-565dc547-082d-461a-b200-80e50f521530 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:06.558369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-565dc547-082d-461a-b200-80e50f521530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.638196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1114/2231] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:06.648383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014ad17-3cda-49b1-a55e-9800687e0025 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.652222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dc547-082d-461a-b200-80e50f521530 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.653839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-565dc547-082d-461a-b200-80e50f521530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.657101 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.657787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.658077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.658363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.659643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.660794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.679562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1118/2232] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:06.683264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.693991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92802aa-59e2-4108-a4c1-91f9cab3f1a9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.699850 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67599bb-92d7-4a46-9fc8-712c52fbfcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.700541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67599bb-92d7-4a46-9fc8-712c52fbfcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.700830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67599bb-92d7-4a46-9fc8-712c52fbfcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.701109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67599bb-92d7-4a46-9fc8-712c52fbfcb0 admin admin] PATH_INFO: `/v3/projects/d37fdd7be08943078e3c7a7468584e62/users/c16d98c4f73a40a09474df6ba9832ab7/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.703356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67599bb-92d7-4a46-9fc8-712c52fbfcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37fdd7be08943078e3c7a7468584e62, user_id=c16d98c4f73a40a09474df6ba9832ab7, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.708371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67599bb-92d7-4a46-9fc8-712c52fbfcb0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.721862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1119/2233] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:06 2022] PUT /identity/v3/projects/d37fdd7be08943078e3c7a7468584e62/users/c16d98c4f73a40a09474df6ba9832ab7/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:06.737757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.738073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.738358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.743742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dc547-082d-461a-b200-80e50f521530 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.777525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] MFA Rules not processed for user `c16d98c4f73a40a09474df6ba9832ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:06.778771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.801646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.802379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.802722 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.803078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.855483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1120/2234] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:06.865752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:06.873305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:06.887646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:06.889100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:06.900649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1115/2235] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:06.962085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e558d6-a8b2-420a-9182-8e22821ee3b5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:06.974038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9b27-478b-4dd9-bff6-2e1da3550650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:06.974746 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9b27-478b-4dd9-bff6-2e1da3550650 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:06.975033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9b27-478b-4dd9-bff6-2e1da3550650 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:06.975307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9b27-478b-4dd9-bff6-2e1da3550650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:06.982365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-698b9b27-478b-4dd9-bff6-2e1da3550650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.061065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b9b27-478b-4dd9-bff6-2e1da3550650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.062913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b9b27-478b-4dd9-bff6-2e1da3550650 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.074647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1121/2236] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:07.289277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.290691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.304865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2b5b-5213-469c-9dc1-35479d0a2c06 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.310911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.311956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.312133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.312521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] PATH_INFO: `/v3/projects/742fc449b8754c1f9229122a1915a722` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.314403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=742fc449b8754c1f9229122a1915a722)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.317717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.377494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742fc449b8754c1f9229122a1915a722', 'request_id': 'req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.384050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742fc449b8754c1f9229122a1915a722', 'request_id': 'req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.390131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742fc449b8754c1f9229122a1915a722', 'request_id': 'req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.409866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] The token cache is being invalidate because project 742fc449b8754c1f9229122a1915a722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:07.410167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.410877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-3b7a5f05-e425-4f21-b3cf-d1b916cbdb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.412576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1116/2237] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:07 2022] DELETE /identity/v3/projects/742fc449b8754c1f9229122a1915a722 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:07.418845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3b6a-9c5e-491f-a3e6-23bef7969889 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.419147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3b6a-9c5e-491f-a3e6-23bef7969889 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.419467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3b6a-9c5e-491f-a3e6-23bef7969889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.436950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-331c3b6a-9c5e-491f-a3e6-23bef7969889 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:07.438181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-331c3b6a-9c5e-491f-a3e6-23bef7969889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.502828 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1122/2238] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:07.512183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74ecc-bab9-4ac8-a7f5-2faf89a88736 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.512686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74ecc-bab9-4ac8-a7f5-2faf89a88736 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.512971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea74ecc-bab9-4ac8-a7f5-2faf89a88736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.531963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-bea74ecc-bab9-4ac8-a7f5-2faf89a88736 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:07.533154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-bea74ecc-bab9-4ac8-a7f5-2faf89a88736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.541022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1117/2239] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:07.545728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3b6a-9c5e-491f-a3e6-23bef7969889 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.555004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3b6a-9c5e-491f-a3e6-23bef7969889 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.560760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.561409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.561689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.561959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.562696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:07.563001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.564767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.577450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1123/2240] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:07.581781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74ecc-bab9-4ac8-a7f5-2faf89a88736 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.591782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea74ecc-bab9-4ac8-a7f5-2faf89a88736 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.596471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.597125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.597410 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.597697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.598426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.600389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.625472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1118/2241] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:07 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:07.628946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.639165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc225e7-e9ab-4b86-a8d9-eb641cfc6a07 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.692640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.693323 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.693615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.693894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.694633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.696558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.717078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1124/2242] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:07 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:07.721268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.732121 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a12168-adbe-4e39-afff-c62451a65568 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.737938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.738705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.739072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.739451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.740280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.742070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.755217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1119/2243] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:37:07.759147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.777193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.777643 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a723-d631-4169-9de9-1006c1161e01 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.779050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.783730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.784096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.784584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.784863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.785694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.787621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.793960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8562b-7a3b-40ab-8fe2-295e8988aa53 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.800688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1125/2244] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:07.804707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.808530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.810116 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.810335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.810618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] PATH_INFO: `/v3/users/3fb2ca1b6bfa45199d63cdf74f480344` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.811894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb2ca1b6bfa45199d63cdf74f480344)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.813881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.815344 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59538bd-7d58-46fd-8ac4-de75188e96ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:07.820417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2846cdc-3a3a-4fff-a793-6154b4d3ed9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:07.821390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2846cdc-3a3a-4fff-a793-6154b4d3ed9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.821757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2846cdc-3a3a-4fff-a793-6154b4d3ed9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.822103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2846cdc-3a3a-4fff-a793-6154b4d3ed9b admin admin] PATH_INFO: `/v3/projects/4236078c6a6c4dba94861f8451f6d6d5/users/ed3d88f0003346e58740516911520abc/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.841156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2846cdc-3a3a-4fff-a793-6154b4d3ed9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4236078c6a6c4dba94861f8451f6d6d5, user_id=ed3d88f0003346e58740516911520abc, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:07.844633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2846cdc-3a3a-4fff-a793-6154b4d3ed9b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:07.864596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb2ca1b6bfa45199d63cdf74f480344'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.865863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1126/2245] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:07 2022] PUT /identity/v3/projects/4236078c6a6c4dba94861f8451f6d6d5/users/ed3d88f0003346e58740516911520abc/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:07.872977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb2ca1b6bfa45199d63cdf74f480344'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.877149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.877624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.878181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.885761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb2ca1b6bfa45199d63cdf74f480344'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.904533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb2ca1b6bfa45199d63cdf74f480344'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.905444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-559a6d84-6fb7-4b0a-8d03-866efc718a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb2ca1b6bfa45199d63cdf74f480344'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:07.910104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] MFA Rules not processed for user `ed3d88f0003346e58740516911520abc`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:07.911324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.911554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1120/2246] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:07 2022] DELETE /identity/v3/users/3fb2ca1b6bfa45199d63cdf74f480344 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:07.915791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:07.916103 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:07.916387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:07.933269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:07.934545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.974360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1127/2247] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:07.984424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:07.985750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:07.993650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1121/2248] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:08.003790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.005172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:08.042642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23ffb5-f586-44a4-837f-56fd1ae8423b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.046595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.047455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.047893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.048168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.056722 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.058693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.063059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad0a4-d66b-40e1-8ae5-8ca066cb166b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.066717 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c706b8-a1e0-4d0f-8e9d-d3384cfeb201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.067203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1128/2249] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:08.069088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c706b8-a1e0-4d0f-8e9d-d3384cfeb201 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.069382 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c706b8-a1e0-4d0f-8e9d-d3384cfeb201 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.069675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c706b8-a1e0-4d0f-8e9d-d3384cfeb201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.079525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c706b8-a1e0-4d0f-8e9d-d3384cfeb201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.080970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c706b8-a1e0-4d0f-8e9d-d3384cfeb201 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.091951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1122/2250] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:08.413352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.415525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:08.432011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f488b1-f843-4ccf-996f-7839bdca579a service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.437536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.438382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.438573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.438854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] PATH_INFO: `/v3/projects/f1b2fe1334bf4f11b99e038385c275dd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.440209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b2fe1334bf4f11b99e038385c275dd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.442125 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.493728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b2fe1334bf4f11b99e038385c275dd', 'request_id': 'req-25bbc58b-a3bb-459a-be16-33dcf8a8165b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:08.502706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b2fe1334bf4f11b99e038385c275dd', 'request_id': 'req-25bbc58b-a3bb-459a-be16-33dcf8a8165b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:08.508436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b2fe1334bf4f11b99e038385c275dd', 'request_id': 'req-25bbc58b-a3bb-459a-be16-33dcf8a8165b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:08.525453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] The token cache is being invalidate because project f1b2fe1334bf4f11b99e038385c275dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:08.525732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:08.526487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25bbc58b-a3bb-459a-be16-33dcf8a8165b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:08.528994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1129/2251] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:08 2022] DELETE /identity/v3/projects/f1b2fe1334bf4f11b99e038385c275dd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:08.535418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.536056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.536056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.557312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:08.559114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:08.618020 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1123/2252] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:08.628767 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db30a-8624-4dfd-a892-aa2c64d19720 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.631172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db30a-8624-4dfd-a892-aa2c64d19720 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.631172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db30a-8624-4dfd-a892-aa2c64d19720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.649045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-649db30a-8624-4dfd-a892-aa2c64d19720 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:08.649231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-649db30a-8624-4dfd-a892-aa2c64d19720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:08.657499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1130/2253] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:08.658189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.659585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:08.661495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db30a-8624-4dfd-a892-aa2c64d19720 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.671599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db30a-8624-4dfd-a892-aa2c64d19720 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.676375 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.677013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.677293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.677566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.678334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:08.678637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.680416 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.696660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1131/2254] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:37:08.697810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.708142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341663f-0127-4f25-b423-c9bf2308902d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.712931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.713587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.713869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.714348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.715132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.717061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.721642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b20acd-4653-461b-8bc0-4aee7ab1ca66 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.725829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.726746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.726872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.727057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.728900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:08.746122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1132/2255] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:08 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:08.750351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.789889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.791648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.801453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1124/2256] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:08.813201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e102b-27d7-461a-89e7-425034ba6faf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.821311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.822008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.822295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.822583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.823298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.825483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.856780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1133/2257] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:08 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:08.863167 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.878882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3911-266f-4602-bd80-d14c397fff39 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.884820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.887036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.887036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.887036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.887928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.892819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.916914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1125/2258] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:08.921718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.937405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e41f67-6716-48c9-81dd-d3427bff6c16 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.946269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192d943-717a-4744-9a7f-c47686e4bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.946958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d943-717a-4744-9a7f-c47686e4bee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.947238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d943-717a-4744-9a7f-c47686e4bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.947558 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d943-717a-4744-9a7f-c47686e4bee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:08.948351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192d943-717a-4744-9a7f-c47686e4bee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:08.949975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192d943-717a-4744-9a7f-c47686e4bee0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:08.961338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1134/2259] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:08.966973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:08.982608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d114b5-9b4d-419e-b9e5-4776f2037085 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:08.987856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:08.989144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:08.989656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:08.990145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] PATH_INFO: `/v3/projects/11b8d12ec9c6424ba41cb8d10866e9d8/users/36722a6407c04d2f9c9682dc69637711/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:09.009808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b8d12ec9c6424ba41cb8d10866e9d8, user_id=36722a6407c04d2f9c9682dc69637711, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:09.015017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:09.034459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1126/2260] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:08 2022] PUT /identity/v3/projects/11b8d12ec9c6424ba41cb8d10866e9d8/users/36722a6407c04d2f9c9682dc69637711/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:09.048107 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7adce-ccf4-4d4a-9004-05731398de8b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:09.048656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7adce-ccf4-4d4a-9004-05731398de8b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:09.048656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7adce-ccf4-4d4a-9004-05731398de8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:09.097964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-afc7adce-ccf4-4d4a-9004-05731398de8b None None] MFA Rules not processed for user `36722a6407c04d2f9c9682dc69637711`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:09.099861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-afc7adce-ccf4-4d4a-9004-05731398de8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:09.188665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1135/2261] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:09.199195 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:09.201237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:09.267692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b362b0c-5245-459a-8609-b3fdfb5a31c8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:09.272846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:09.273732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:09.274019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:09.274297 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:09.284658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:09.286286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:09.296472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1127/2262] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:09.327978 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7adce-ccf4-4d4a-9004-05731398de8b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:09.404907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7adce-ccf4-4d4a-9004-05731398de8b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:09.410570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:09.410716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:09.410959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:09.411231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] PATH_INFO: `/v3/users/36722a6407c04d2f9c9682dc69637711` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:09.412489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=36722a6407c04d2f9c9682dc69637711)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:09.414430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:09.487106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:09.496550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9a088-5768-43ce-b0da-8db228a06641 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:09.500268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:09.500909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:09.501202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:09.501464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:09.503276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:09.518227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36722a6407c04d2f9c9682dc69637711'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:09.528786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36722a6407c04d2f9c9682dc69637711'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:09.543305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36722a6407c04d2f9c9682dc69637711'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:09.560985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36722a6407c04d2f9c9682dc69637711'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:09.561781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2057e265-654e-4e98-933b-959d33ed2bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36722a6407c04d2f9c9682dc69637711'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:09.569703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1136/2263] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:09 2022] DELETE /identity/v3/users/36722a6407c04d2f9c9682dc69637711 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:09.574399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:09.575570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:09.575877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:09.606237 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:09.607499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:09.608642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:09.610224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:09.623494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1128/2264] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:09.683790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1137/2265] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:09.693461 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:09.695169 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:09.755505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1610d-1827-49c3-aad2-b007ac4ba6fc service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:09.802724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c80d62-b4f3-4e8b-9fdf-751681c7bbb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:09.803290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80d62-b4f3-4e8b-9fdf-751681c7bbb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:09.803596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80d62-b4f3-4e8b-9fdf-751681c7bbb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:09.803871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80d62-b4f3-4e8b-9fdf-751681c7bbb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:09.813163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c80d62-b4f3-4e8b-9fdf-751681c7bbb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:09.814597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c80d62-b4f3-4e8b-9fdf-751681c7bbb9 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:09.824338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1129/2266] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:10.085430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.086982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:10.107009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c5556-6414-4536-93e1-a16f119c9638 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.111793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.112729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.112921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.113198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] PATH_INFO: `/v3/projects/11b8d12ec9c6424ba41cb8d10866e9d8` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.114485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b8d12ec9c6424ba41cb8d10866e9d8)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.116431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.165039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b8d12ec9c6424ba41cb8d10866e9d8', 'request_id': 'req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.173056 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b8d12ec9c6424ba41cb8d10866e9d8', 'request_id': 'req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.179659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b8d12ec9c6424ba41cb8d10866e9d8', 'request_id': 'req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.191770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] The token cache is being invalidate because project 11b8d12ec9c6424ba41cb8d10866e9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:10.192058 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.192748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c03e47f-dbd3-4fa0-9eaf-fd024c384ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.194402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1138/2267] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:10 2022] DELETE /identity/v3/projects/11b8d12ec9c6424ba41cb8d10866e9d8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:10.200373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f20ed-22aa-4e63-b657-33715e61a3cf None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.200667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f20ed-22aa-4e63-b657-33715e61a3cf None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.200953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f20ed-22aa-4e63-b657-33715e61a3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.220908 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-115f20ed-22aa-4e63-b657-33715e61a3cf None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:10.222157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-115f20ed-22aa-4e63-b657-33715e61a3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:10.282033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1130/2268] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:10.289858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eafef-e61f-41fc-a4fd-57621781a661 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.290154 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eafef-e61f-41fc-a4fd-57621781a661 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.290437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88eafef-e61f-41fc-a4fd-57621781a661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.309579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b88eafef-e61f-41fc-a4fd-57621781a661 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:10.310800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b88eafef-e61f-41fc-a4fd-57621781a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:10.318886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1139/2269] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:10.323022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f20ed-22aa-4e63-b657-33715e61a3cf None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.332698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f20ed-22aa-4e63-b657-33715e61a3cf None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.337194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.337829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.338111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.338387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.339646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:10.339951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.341917 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.354223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1131/2270] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:10.359064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88eafef-e61f-41fc-a4fd-57621781a661 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.368776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88eafef-e61f-41fc-a4fd-57621781a661 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.373613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.374276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.374553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.374824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.375568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.377454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.406063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1140/2271] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:10 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:10.410295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.421630 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0becf4-ef14-444e-bfa7-04d16ed7e7b2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.477918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.478582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.478866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.479144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.479974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.482395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.505076 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1132/2272] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:10 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:10.506645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.516984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5b1d5-be5c-444a-b7d7-9abb53e9c7ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.521526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.522172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.522452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.522725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.523494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.525073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.535804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1141/2273] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:10.540094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.550959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c97c9d-f944-4e01-a010-2c047a840a72 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.555632 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c8dfa-d131-4fbe-aca9-5dceba3a6b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.556309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c8dfa-d131-4fbe-aca9-5dceba3a6b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.556593 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c8dfa-d131-4fbe-aca9-5dceba3a6b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.556872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c8dfa-d131-4fbe-aca9-5dceba3a6b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.557610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c8dfa-d131-4fbe-aca9-5dceba3a6b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.559232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c8dfa-d131-4fbe-aca9-5dceba3a6b63 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.568729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1133/2274] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:10.572412 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.582111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c14b8-1ed3-4ccb-b5e1-cea17af199ab admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.587190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.588047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.588330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.588607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] PATH_INFO: `/v3/projects/53ef738e89a54d6688ef2e0c3099648d/users/ae048bce227e4cb580da3993c443f6e6/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.603644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ef738e89a54d6688ef2e0c3099648d, user_id=ae048bce227e4cb580da3993c443f6e6, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.606921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.620425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1142/2275] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:10 2022] PUT /identity/v3/projects/53ef738e89a54d6688ef2e0c3099648d/users/ae048bce227e4cb580da3993c443f6e6/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:10.630473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.630964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.631115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.659256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] MFA Rules not processed for user `ae048bce227e4cb580da3993c443f6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:10.660517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:10.693245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.695163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:10.738293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1134/2276] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:10.749281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:10.754907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:10.786859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563245d1-359e-4973-9823-3a087ed7db2c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.792698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.793712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.794005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.794288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] PATH_INFO: `/v3/users/ed3d88f0003346e58740516911520abc` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.795709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3d88f0003346e58740516911520abc)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.797625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.834254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab231042-c3cc-469e-b533-4198ae52ab26 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:10.839760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a7134-f6e3-4004-b247-e6c37b804bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:10.840807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7134-f6e3-4004-b247-e6c37b804bbf service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.841370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7134-f6e3-4004-b247-e6c37b804bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.841820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7134-f6e3-4004-b247-e6c37b804bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.858569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a7134-f6e3-4004-b247-e6c37b804bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:10.860994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a7134-f6e3-4004-b247-e6c37b804bbf service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:10.872789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1135/2277] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:10.897352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3d88f0003346e58740516911520abc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.908568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3d88f0003346e58740516911520abc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.923171 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3d88f0003346e58740516911520abc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.946553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3d88f0003346e58740516911520abc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.947625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3d88f0003346e58740516911520abc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:10.960053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1143/2278] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:10 2022] DELETE /identity/v3/users/ed3d88f0003346e58740516911520abc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:10.961897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:10.962531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:10.962775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:10.987414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:10.988650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:11.101807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1136/2279] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:11.112095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.113561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:11.198060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6908d-d346-4d3d-adef-53f381e3e9ec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:11.198060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db39fbf-fca8-4647-89ee-31dfd939cfca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:11.198337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db39fbf-fca8-4647-89ee-31dfd939cfca service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.199006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db39fbf-fca8-4647-89ee-31dfd939cfca service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.199183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db39fbf-fca8-4647-89ee-31dfd939cfca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.210110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db39fbf-fca8-4647-89ee-31dfd939cfca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:11.211735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db39fbf-fca8-4647-89ee-31dfd939cfca service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:11.222829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1144/2280] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:11.499724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.501151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:11.515025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c875b89-81f7-4597-946b-0e5ff3b4c441 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:11.519764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:11.520621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.520934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.521213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] PATH_INFO: `/v3/projects/4236078c6a6c4dba94861f8451f6d6d5` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.522441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4236078c6a6c4dba94861f8451f6d6d5)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:11.524389 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:11.572503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4236078c6a6c4dba94861f8451f6d6d5', 'request_id': 'req-d014f2fb-0080-4378-9042-92a159fe6c85'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:11.578949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4236078c6a6c4dba94861f8451f6d6d5', 'request_id': 'req-d014f2fb-0080-4378-9042-92a159fe6c85'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:11.584179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4236078c6a6c4dba94861f8451f6d6d5', 'request_id': 'req-d014f2fb-0080-4378-9042-92a159fe6c85'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:11.596713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] The token cache is being invalidate because project 4236078c6a6c4dba94861f8451f6d6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:11.597015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:11.597623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d014f2fb-0080-4378-9042-92a159fe6c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:11.599416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1137/2281] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:11 2022] DELETE /identity/v3/projects/4236078c6a6c4dba94861f8451f6d6d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:11.605176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43e797-f9ee-4e0d-b15b-4251f710cbef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.605470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43e797-f9ee-4e0d-b15b-4251f710cbef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.605752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43e797-f9ee-4e0d-b15b-4251f710cbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.623002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9f43e797-f9ee-4e0d-b15b-4251f710cbef None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:11.624180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9f43e797-f9ee-4e0d-b15b-4251f710cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:11.683200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1145/2282] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:11.691107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b232f-e8d3-4e75-b04f-a33539bea4f0 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.691604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b232f-e8d3-4e75-b04f-a33539bea4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.691725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b232f-e8d3-4e75-b04f-a33539bea4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.710735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e87b232f-e8d3-4e75-b04f-a33539bea4f0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:11.711947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e87b232f-e8d3-4e75-b04f-a33539bea4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:11.720609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1138/2283] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:11.725277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43e797-f9ee-4e0d-b15b-4251f710cbef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.735884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43e797-f9ee-4e0d-b15b-4251f710cbef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:11.741105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:11.741771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.742055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.742335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.743158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:11.743513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:11.745718 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:11.759782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1146/2284] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:37:11.764815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b232f-e8d3-4e75-b04f-a33539bea4f0 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.774260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b232f-e8d3-4e75-b04f-a33539bea4f0 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:11.779018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:11.779952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.780236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.780515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.781217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:11.783207 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:11.810739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1139/2285] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:11 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:11.811865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.822596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936e18-1eba-429f-904e-13489c049e38 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:11.886515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:11.887219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.887641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.887920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.888640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:11.890545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:11.914089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1147/2286] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:11 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:11.918248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.929124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7de9-ec70-471d-8209-000939104111 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:11.934486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:11.935156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.935473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.935758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.936504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:11.938106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:11.949751 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1140/2287] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:11.954086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.964596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab3174-c4e5-493b-9b2e-82198187aeec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:11.969395 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fae414-17cf-4010-a233-c508fba7f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:11.970053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae414-17cf-4010-a233-c508fba7f692 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:11.970340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae414-17cf-4010-a233-c508fba7f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:11.970618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fae414-17cf-4010-a233-c508fba7f692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:11.971362 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fae414-17cf-4010-a233-c508fba7f692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:11.972991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fae414-17cf-4010-a233-c508fba7f692 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:11.986598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1148/2288] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:11.988227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:11.998786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afece842-37ef-4ec6-9a81-41c755d0f609 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:12.003629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:12.004511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:12.004793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:12.005070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] PATH_INFO: `/v3/projects/2f5a4bcebbff4cb7940464dc77727b0e/users/ee10df6534284c08973b7d11977def60/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:12.027763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5a4bcebbff4cb7940464dc77727b0e, user_id=ee10df6534284c08973b7d11977def60, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:12.027763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:12.037919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1141/2289] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:11 2022] PUT /identity/v3/projects/2f5a4bcebbff4cb7940464dc77727b0e/users/ee10df6534284c08973b7d11977def60/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:12.042951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adfe46-1ae6-48c1-aa33-aaec0c3e964b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:12.043239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adfe46-1ae6-48c1-aa33-aaec0c3e964b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:12.043569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adfe46-1ae6-48c1-aa33-aaec0c3e964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:12.063600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-72adfe46-1ae6-48c1-aa33-aaec0c3e964b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:12.064861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-72adfe46-1ae6-48c1-aa33-aaec0c3e964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:12.128632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1149/2290] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:12.139212 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:12.140981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:12.215839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156c7d-ee72-4039-82d7-0731eb544623 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:12.220635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:12.221323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:12.221755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:12.222043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:12.234494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:12.236227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:12.253660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1142/2291] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:13.014001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:13.014317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:13.014603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:13.042045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] MFA Rules not processed for user `ee10df6534284c08973b7d11977def60`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:13.043241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:13.109986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1150/2292] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:13.119288 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:13.120977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:13.185859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e4dd0-c346-4765-a455-c6a12e33e5ec service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:13.189490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a654028-13e4-44e5-90c2-42e384f3ea3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:13.190129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654028-13e4-44e5-90c2-42e384f3ea3b service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:13.190409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654028-13e4-44e5-90c2-42e384f3ea3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:13.190681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654028-13e4-44e5-90c2-42e384f3ea3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:13.199296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654028-13e4-44e5-90c2-42e384f3ea3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:13.200680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654028-13e4-44e5-90c2-42e384f3ea3b service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:13.209128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1143/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:13.886378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:13.888589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:13.900151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb2ba0-d634-4c03-953b-c087852c78bd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:13.903741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:13.904655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:13.904937 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:13.905213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:13.906933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:13.969396 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:13.970911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:13.981012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1151/2294] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:16.646332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a231-7e64-40a4-82c7-40685d937335 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:16.646868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a231-7e64-40a4-82c7-40685d937335 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:16.646978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a231-7e64-40a4-82c7-40685d937335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:16.672128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-84e7a231-7e64-40a4-82c7-40685d937335 None None] MFA Rules not processed for user `ee10df6534284c08973b7d11977def60`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:16.673655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-84e7a231-7e64-40a4-82c7-40685d937335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:16.681502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1144/2295] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:16.945238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:16.946985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:16.961115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3a6ae-1d1b-4fce-b613-084c75ec2eed service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:16.966269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:16.967364 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:16.967790 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:16.968293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] PATH_INFO: `/v3/users/daf567815b4b4131a66a59b03164577c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:16.969810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf567815b4b4131a66a59b03164577c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:16.972418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:17.030760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf567815b4b4131a66a59b03164577c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:17.038826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf567815b4b4131a66a59b03164577c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:17.046865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf567815b4b4131a66a59b03164577c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:17.060276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf567815b4b4131a66a59b03164577c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:17.061181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf567815b4b4131a66a59b03164577c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:17.069292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1152/2296] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:16 2022] DELETE /identity/v3/users/daf567815b4b4131a66a59b03164577c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:17.074120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:17.074487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:17.074875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:17.101132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:17.102469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:17.186777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1145/2297] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:17.199247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:17.201459 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:17.289937 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31216e51-1541-4523-a2de-a8cda5f77924 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:17.296339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:17.297212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:17.297776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:17.298508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:17.310970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:17.312725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:17.326724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1153/2298] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:17.888843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:17.891692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:17.929057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dac25-d830-43d6-81ae-d41775f8ab42 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:17.937062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:17.939011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:17.939499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:17.940087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] PATH_INFO: `/v3/projects/8aebfd77edf24ebea6522ea744ea5503` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:17.941726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aebfd77edf24ebea6522ea744ea5503)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:17.944094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:18.004515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aebfd77edf24ebea6522ea744ea5503', 'request_id': 'req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.013556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aebfd77edf24ebea6522ea744ea5503', 'request_id': 'req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.022432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aebfd77edf24ebea6522ea744ea5503', 'request_id': 'req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.039564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] The token cache is being invalidate because project 8aebfd77edf24ebea6522ea744ea5503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:18.040000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.040782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.044805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1146/2299] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:17 2022] DELETE /identity/v3/projects/8aebfd77edf24ebea6522ea744ea5503 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:18.048915 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:18.059513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27be9-263f-42d1-8144-dba4f8afde9f service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:18.118108 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:18.118995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:18.119264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:18.119577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] PATH_INFO: `/v3/users/5e22771d85224a49a23404c2310df2c6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:18.120829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e22771d85224a49a23404c2310df2c6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:18.122840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:18.169972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e22771d85224a49a23404c2310df2c6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.177292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e22771d85224a49a23404c2310df2c6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.190040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e22771d85224a49a23404c2310df2c6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.212771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e22771d85224a49a23404c2310df2c6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.214980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e22771d85224a49a23404c2310df2c6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.226934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1154/2300] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:18 2022] DELETE /identity/v3/users/5e22771d85224a49a23404c2310df2c6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:18.627495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:18.629014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:18.642914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbf104-0e3e-43d6-9ea3-2031af9a8063 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:18.698038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:18.699415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:18.699714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:18.700018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] PATH_INFO: `/v3/projects/2c1693a4fe8146e6b5f3b8f4fa7861c2` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:18.701215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1693a4fe8146e6b5f3b8f4fa7861c2)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:18.703114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:18.751144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1693a4fe8146e6b5f3b8f4fa7861c2', 'request_id': 'req-c9944295-8009-4385-a7e9-d3724ed57e39'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.757309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1693a4fe8146e6b5f3b8f4fa7861c2', 'request_id': 'req-c9944295-8009-4385-a7e9-d3724ed57e39'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.763476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1693a4fe8146e6b5f3b8f4fa7861c2', 'request_id': 'req-c9944295-8009-4385-a7e9-d3724ed57e39'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.776359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] The token cache is being invalidate because project 2c1693a4fe8146e6b5f3b8f4fa7861c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:18.776657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.777298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.778856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1147/2301] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:18 2022] DELETE /identity/v3/projects/2c1693a4fe8146e6b5f3b8f4fa7861c2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:18.783183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:18.784631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:18.798083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466fe7-700d-4016-8dbc-9dc594ae5568 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:18.859491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:18.860383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:18.861275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:18.861568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] PATH_INFO: `/v3/users/c16d98c4f73a40a09474df6ba9832ab7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:18.863577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16d98c4f73a40a09474df6ba9832ab7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:18.866037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:18.919470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16d98c4f73a40a09474df6ba9832ab7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.926368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16d98c4f73a40a09474df6ba9832ab7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.933611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16d98c4f73a40a09474df6ba9832ab7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.944935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16d98c4f73a40a09474df6ba9832ab7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.945603 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ed0dc887-a261-4936-a7dd-f34cf9d7c551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16d98c4f73a40a09474df6ba9832ab7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:18.951328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1155/2302] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:18 2022] DELETE /identity/v3/users/c16d98c4f73a40a09474df6ba9832ab7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:19.208558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.210112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:19.223957 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9944295-8009-4385-a7e9-d3724ed57e39 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.285339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.286198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.286482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.286762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] PATH_INFO: `/v3/projects/d37fdd7be08943078e3c7a7468584e62` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.288086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37fdd7be08943078e3c7a7468584e62)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.290001 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.334423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37fdd7be08943078e3c7a7468584e62', 'request_id': 'req-349eea0a-8eb5-4430-83fa-00d14d4fcd11'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:19.341000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37fdd7be08943078e3c7a7468584e62', 'request_id': 'req-349eea0a-8eb5-4430-83fa-00d14d4fcd11'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:19.346377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37fdd7be08943078e3c7a7468584e62', 'request_id': 'req-349eea0a-8eb5-4430-83fa-00d14d4fcd11'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:19.360107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] The token cache is being invalidate because project d37fdd7be08943078e3c7a7468584e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:19.360393 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:19.361025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-349eea0a-8eb5-4430-83fa-00d14d4fcd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:19.362664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1148/2303] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:19 2022] DELETE /identity/v3/projects/d37fdd7be08943078e3c7a7468584e62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:19.368616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c5d48-5241-44f7-9113-3b737f8311b6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.369116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c5d48-5241-44f7-9113-3b737f8311b6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.369211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c5d48-5241-44f7-9113-3b737f8311b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.388577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-449c5d48-5241-44f7-9113-3b737f8311b6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:19.389785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-449c5d48-5241-44f7-9113-3b737f8311b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:19.448666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1156/2304] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:19.456662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b573c-d868-437a-9ff4-5de9bbb3d9ba None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.456895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b573c-d868-437a-9ff4-5de9bbb3d9ba None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.457172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b573c-d868-437a-9ff4-5de9bbb3d9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.475706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-281b573c-d868-437a-9ff4-5de9bbb3d9ba None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:19.476896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-281b573c-d868-437a-9ff4-5de9bbb3d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:19.484606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1149/2305] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:19.488537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c5d48-5241-44f7-9113-3b737f8311b6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.498659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c5d48-5241-44f7-9113-3b737f8311b6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.503338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.504026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.504311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.504619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.505367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:19.505678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.507286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.519288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1157/2306] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:19.523685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b573c-d868-437a-9ff4-5de9bbb3d9ba None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.532905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b573c-d868-437a-9ff4-5de9bbb3d9ba None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.537501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.538140 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.538450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.538748 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.539471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.541333 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.565687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1150/2307] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:19 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:19.569769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.585294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb611126-5e12-4313-85c3-63a964ae010d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.641343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.642008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.642294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.642570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.643266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.645265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.664302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1158/2308] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:19 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:19.669063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.679129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee465-17d5-479b-8783-ce8f344de362 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.684331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.685004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.685284 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.685558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.686290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.687900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.697764 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1151/2309] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:19.701504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.711147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0c02e-deab-45c6-b761-3eb8ce97f2ce admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.715837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49d9a6-c64b-4f50-bd87-b49317786777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.716482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49d9a6-c64b-4f50-bd87-b49317786777 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.716764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49d9a6-c64b-4f50-bd87-b49317786777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.717040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49d9a6-c64b-4f50-bd87-b49317786777 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.717777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49d9a6-c64b-4f50-bd87-b49317786777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.719479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49d9a6-c64b-4f50-bd87-b49317786777 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.729034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1159/2310] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:19.733613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.744712 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc8568-f3ee-479e-9003-b2b19d5bd6a8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.750066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.750936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.751217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.751528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] PATH_INFO: `/v3/projects/3eadb55db1f245c8baad6d5e04f838e2/users/198de471005a455d8db68e00405f8a43/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.765641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eadb55db1f245c8baad6d5e04f838e2, user_id=198de471005a455d8db68e00405f8a43, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.768443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.780933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1152/2311] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:19 2022] PUT /identity/v3/projects/3eadb55db1f245c8baad6d5e04f838e2/users/198de471005a455d8db68e00405f8a43/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:37:19.792413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.792704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.792985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.818164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] MFA Rules not processed for user `198de471005a455d8db68e00405f8a43`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:19.819354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:19.881027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1160/2312] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:19.890734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:19.892446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:19.952160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a48e8b-53de-49bd-977d-cca7347ebf6e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:19.955940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f06cc-ad21-4761-9fbc-b776b0443584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:19.956594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f06cc-ad21-4761-9fbc-b776b0443584 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:19.956880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f06cc-ad21-4761-9fbc-b776b0443584 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:19.957160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f06cc-ad21-4761-9fbc-b776b0443584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:19.966956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f06cc-ad21-4761-9fbc-b776b0443584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:19.968369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f06cc-ad21-4761-9fbc-b776b0443584 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:19.978983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1153/2313] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:35.842619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:35.845017 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:35.925314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf2ffe-ac37-43c6-818a-6ef0c7983339 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:35.930641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:35.931169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:35.931474 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:35.931785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] PATH_INFO: `/v3/users/ae048bce227e4cb580da3993c443f6e6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:35.933110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae048bce227e4cb580da3993c443f6e6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:35.935044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:36.013279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae048bce227e4cb580da3993c443f6e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.021965 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae048bce227e4cb580da3993c443f6e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.031532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae048bce227e4cb580da3993c443f6e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.045092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae048bce227e4cb580da3993c443f6e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.045959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f6253b59-45d2-4073-845d-3d06ca30a8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae048bce227e4cb580da3993c443f6e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.051998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1161/2314] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:35 2022] DELETE /identity/v3/users/ae048bce227e4cb580da3993c443f6e6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:36.057238 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:36.057687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:36.057790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:36.078211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:36.079738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:36.089255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:36.089255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:36.089255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:36.109367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] MFA Rules not processed for user `93bd2a35edc74582b837a2e76b92bc93`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:36.110499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:36.159295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1154/2315] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:36.169335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:36.171013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:36.172263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1162/2316] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Feb 07 20:37:36.228861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b32a-ae7f-4415-9e7d-d265481ab836 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:36.232830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:36.233473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:36.233756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:36.234034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:36.245189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:36.246627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:36.257109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1155/2317] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:37:36.655515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:36.657210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:36.671989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5963b7-8191-46ba-8e0d-e1e4bdca4709 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:36.677482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:36.678577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:36.678694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:36.678970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] PATH_INFO: `/v3/projects/53ef738e89a54d6688ef2e0c3099648d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:36.680689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ef738e89a54d6688ef2e0c3099648d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:36.684360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:36.740564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ef738e89a54d6688ef2e0c3099648d', 'request_id': 'req-cb9e44fb-b172-4854-8123-ccfe67665256'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.748699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ef738e89a54d6688ef2e0c3099648d', 'request_id': 'req-cb9e44fb-b172-4854-8123-ccfe67665256'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.754224 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ef738e89a54d6688ef2e0c3099648d', 'request_id': 'req-cb9e44fb-b172-4854-8123-ccfe67665256'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.766406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] The token cache is being invalidate because project 53ef738e89a54d6688ef2e0c3099648d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:36.766721 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.767516 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cb9e44fb-b172-4854-8123-ccfe67665256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:36.769451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1163/2318] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:36 2022] DELETE /identity/v3/projects/53ef738e89a54d6688ef2e0c3099648d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:37.439203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:37.440738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:37.469372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b61d09-041d-4c80-893b-855739991bd9 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:37.611747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:37.612749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:37.613130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:37.613503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] PATH_INFO: `/v3/users/198de471005a455d8db68e00405f8a43` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:37.614985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=198de471005a455d8db68e00405f8a43)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:37.617045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:37.670091 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198de471005a455d8db68e00405f8a43'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:37.676975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198de471005a455d8db68e00405f8a43'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:37.688111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198de471005a455d8db68e00405f8a43'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:37.695513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198de471005a455d8db68e00405f8a43'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:37.696472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198de471005a455d8db68e00405f8a43'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:37.703626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1156/2319] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:37 2022] DELETE /identity/v3/users/198de471005a455d8db68e00405f8a43 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:37.710413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:37.710941 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:37.710941 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:37.729584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:37.730926 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:37.792452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1164/2320] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:37.801861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:37.803353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:37.877415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3160-478d-4f6c-861b-85a201085482 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:37.881424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:37.882208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:37.882553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:37.882962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:37.893515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:37.895025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:37.906130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1157/2321] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:38.370985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:38.373060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:38.389130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670c91c-c1ce-45df-b386-7ca3dfbfce90 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:38.395649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:38.396962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:38.403609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:38.404026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] PATH_INFO: `/v3/projects/3eadb55db1f245c8baad6d5e04f838e2` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:38.406377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eadb55db1f245c8baad6d5e04f838e2)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:38.409509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:38.468002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eadb55db1f245c8baad6d5e04f838e2', 'request_id': 'req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:38.474557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eadb55db1f245c8baad6d5e04f838e2', 'request_id': 'req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:38.480358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eadb55db1f245c8baad6d5e04f838e2', 'request_id': 'req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:38.490764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] The token cache is being invalidate because project 3eadb55db1f245c8baad6d5e04f838e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:38.491047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:38.491686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d83d7c69-6edf-4c89-a0c0-e3cf560c6f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:38.493186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1165/2322] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:38 2022] DELETE /identity/v3/projects/3eadb55db1f245c8baad6d5e04f838e2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:47.308312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:47.309736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:47.322893 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4ce9e-44b3-48ae-a477-1abdfe288010 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:47.376080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:47.376936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:47.377218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:47.377493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] PATH_INFO: `/v3/users/cb75ef23d08b41d28f7ef01f847125ab` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:47.378658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb75ef23d08b41d28f7ef01f847125ab)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:47.380635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:47.425835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb75ef23d08b41d28f7ef01f847125ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:47.433650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb75ef23d08b41d28f7ef01f847125ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:47.451162 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb75ef23d08b41d28f7ef01f847125ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:47.459585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb75ef23d08b41d28f7ef01f847125ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:47.460194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb75ef23d08b41d28f7ef01f847125ab'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:47.466034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1158/2323] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:47 2022] DELETE /identity/v3/users/cb75ef23d08b41d28f7ef01f847125ab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:47.470797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:47.471261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:47.471368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:47.490231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:47.491434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:47.548405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1166/2324] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:47.558652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:47.560049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:47.617556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b5bb-69ff-4825-a7e4-a42cf9132197 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:47.621328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4049adc-c7d0-4821-9065-aeaa6e363556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:47.621939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049adc-c7d0-4821-9065-aeaa6e363556 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:47.622224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049adc-c7d0-4821-9065-aeaa6e363556 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:47.622501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049adc-c7d0-4821-9065-aeaa6e363556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:47.631839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4049adc-c7d0-4821-9065-aeaa6e363556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:47.633285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4049adc-c7d0-4821-9065-aeaa6e363556 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:47.643804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1159/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:47.981330 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:47.982735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:47.996703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219af75a-b28b-4172-823d-1cf0cc5ae166 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.001349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.002137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.002438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.002725 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] PATH_INFO: `/v3/projects/6a6c56ea45364186949fbe8fe401a723` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.003922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6c56ea45364186949fbe8fe401a723)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.006689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.053824 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6c56ea45364186949fbe8fe401a723', 'request_id': 'req-418784d6-741e-40e7-ac00-9e8548907dee'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:48.061067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6c56ea45364186949fbe8fe401a723', 'request_id': 'req-418784d6-741e-40e7-ac00-9e8548907dee'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:48.066741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6c56ea45364186949fbe8fe401a723', 'request_id': 'req-418784d6-741e-40e7-ac00-9e8548907dee'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:48.077510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] The token cache is being invalidate because project 6a6c56ea45364186949fbe8fe401a723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:48.077800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:48.078436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-418784d6-741e-40e7-ac00-9e8548907dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:48.080001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1167/2326] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:47 2022] DELETE /identity/v3/projects/6a6c56ea45364186949fbe8fe401a723 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:48.086363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f7e0-d648-4644-a233-47c5bb27cb3f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.086661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f7e0-d648-4644-a233-47c5bb27cb3f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.086946 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f7e0-d648-4644-a233-47c5bb27cb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.106264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-45c6f7e0-d648-4644-a233-47c5bb27cb3f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:48.107583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-45c6f7e0-d648-4644-a233-47c5bb27cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:48.165090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1160/2327] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:48.173158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71604-0f2f-40ce-b112-5e5ca8020155 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.173465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71604-0f2f-40ce-b112-5e5ca8020155 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.173752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71604-0f2f-40ce-b112-5e5ca8020155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.192900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0ef71604-0f2f-40ce-b112-5e5ca8020155 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:48.194092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0ef71604-0f2f-40ce-b112-5e5ca8020155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:48.202276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1168/2328] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:48.206128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6f7e0-d648-4644-a233-47c5bb27cb3f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:48.215752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6f7e0-d648-4644-a233-47c5bb27cb3f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.220651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.221356 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.221641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.221920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.222740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:48.223051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.224775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.236922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1161/2329] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:48.241309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71604-0f2f-40ce-b112-5e5ca8020155 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:48.251313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71604-0f2f-40ce-b112-5e5ca8020155 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.256143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.256854 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.257200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.257547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.258317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.260817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.291965 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1169/2330] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:48 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:48.293211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:48.303240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a956-a784-43db-892a-94fefd2099c5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.363881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.364589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.364834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.365122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.365826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.367795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.388664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1162/2331] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:48 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:37:48.392929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:48.403226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342f373-e66e-4be7-b1c1-c14729ed4062 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.410003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.410675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.410965 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.411247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.412025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.413634 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.424585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1170/2332] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:48.428607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:48.439039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952dc72-8152-4fe5-9ba5-e777cad7aeda admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.443648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbdbce-e7b0-48a9-91a5-6a3a0f573932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.444294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdbce-e7b0-48a9-91a5-6a3a0f573932 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.444579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdbce-e7b0-48a9-91a5-6a3a0f573932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.444857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdbce-e7b0-48a9-91a5-6a3a0f573932 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.445591 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbdbce-e7b0-48a9-91a5-6a3a0f573932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.447245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbdbce-e7b0-48a9-91a5-6a3a0f573932 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.457505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1163/2333] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:48.461899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:48.472016 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03c58-90e4-46b3-99cb-43504e2a93ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.476656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.477531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.477838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.478658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] PATH_INFO: `/v3/projects/085c445c056d46a6951db26c6bec47f6/users/99f00e4090be472a94bd9129a284e96a/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.493468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] RBAC: Authorizing `identity:create_grant(project_id=085c445c056d46a6951db26c6bec47f6, user_id=99f00e4090be472a94bd9129a284e96a, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.496713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.510397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1171/2334] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:48 2022] PUT /identity/v3/projects/085c445c056d46a6951db26c6bec47f6/users/99f00e4090be472a94bd9129a284e96a/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:48.520780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab96e4-c398-44f9-aa5e-95ddcd685b00 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.521102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab96e4-c398-44f9-aa5e-95ddcd685b00 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.521386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab96e4-c398-44f9-aa5e-95ddcd685b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.548793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-88ab96e4-c398-44f9-aa5e-95ddcd685b00 None None] MFA Rules not processed for user `99f00e4090be472a94bd9129a284e96a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:48.550005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-88ab96e4-c398-44f9-aa5e-95ddcd685b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:48.614531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1164/2335] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:48.626665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:48.628394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:48.684991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5d74c-d3f3-4091-89b7-84a56951979c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:48.688934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6f055-e5c6-4427-9c02-bf40c1ae68e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:48.689695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6f055-e5c6-4427-9c02-bf40c1ae68e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:48.690084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6f055-e5c6-4427-9c02-bf40c1ae68e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:48.690463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6f055-e5c6-4427-9c02-bf40c1ae68e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:48.699712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6f055-e5c6-4427-9c02-bf40c1ae68e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:48.701452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6f055-e5c6-4427-9c02-bf40c1ae68e0 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:48.710993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1172/2336] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:56.716814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab96e4-c398-44f9-aa5e-95ddcd685b00 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:56.799664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab96e4-c398-44f9-aa5e-95ddcd685b00 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:56.807915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:56.808798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:56.809087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:56.809430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] PATH_INFO: `/v3/users/99f00e4090be472a94bd9129a284e96a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:56.810711 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f00e4090be472a94bd9129a284e96a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:56.812758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:56.886634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f00e4090be472a94bd9129a284e96a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:56.893483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f00e4090be472a94bd9129a284e96a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:56.906899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f00e4090be472a94bd9129a284e96a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:56.917183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f00e4090be472a94bd9129a284e96a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:56.918013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f00e4090be472a94bd9129a284e96a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:56.931599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1165/2337] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:37:56 2022] DELETE /identity/v3/users/99f00e4090be472a94bd9129a284e96a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:56.933297 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:56.933740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:56.933879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:56.952063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:56.953572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:57.012927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1173/2338] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:57.022801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.024279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:57.081299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844329-1544-419c-8e9f-76c2fbc8418d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.085028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebd711-9d50-4e28-a881-f658bfcdb5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.085667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebd711-9d50-4e28-a881-f658bfcdb5ce service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.085949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebd711-9d50-4e28-a881-f658bfcdb5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.086231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebd711-9d50-4e28-a881-f658bfcdb5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.096217 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebd711-9d50-4e28-a881-f658bfcdb5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.097661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebd711-9d50-4e28-a881-f658bfcdb5ce service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:57.108344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1166/2339] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:37:57.459870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.463636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:57.477251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96519-2129-4395-ac22-5d68928a9fec None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.482626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.483553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.483841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.484225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] PATH_INFO: `/v3/projects/085c445c056d46a6951db26c6bec47f6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.485335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] RBAC: Authorizing `identity:delete_project(project_id=085c445c056d46a6951db26c6bec47f6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.487306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:57.533054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085c445c056d46a6951db26c6bec47f6', 'request_id': 'req-d4ea5808-8f08-4f2b-a2ff-8f568989659b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:57.539595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085c445c056d46a6951db26c6bec47f6', 'request_id': 'req-d4ea5808-8f08-4f2b-a2ff-8f568989659b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:57.545595 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085c445c056d46a6951db26c6bec47f6', 'request_id': 'req-d4ea5808-8f08-4f2b-a2ff-8f568989659b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:57.556240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] The token cache is being invalidate because project 085c445c056d46a6951db26c6bec47f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:37:57.556524 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:57.557166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d4ea5808-8f08-4f2b-a2ff-8f568989659b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:37:57.558685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1174/2340] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:37:57 2022] DELETE /identity/v3/projects/085c445c056d46a6951db26c6bec47f6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:57.564862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25354bf0-297a-4341-97cf-b9078600e3f2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.565150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25354bf0-297a-4341-97cf-b9078600e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.565429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25354bf0-297a-4341-97cf-b9078600e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.582859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-25354bf0-297a-4341-97cf-b9078600e3f2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:57.584067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-25354bf0-297a-4341-97cf-b9078600e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:57.641499 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1167/2341] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:57.650086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258774e-abea-40c9-968a-9f6abee766fc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.650384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258774e-abea-40c9-968a-9f6abee766fc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.650664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258774e-abea-40c9-968a-9f6abee766fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.669962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0258774e-abea-40c9-968a-9f6abee766fc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:57.671258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0258774e-abea-40c9-968a-9f6abee766fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:57.679464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1175/2342] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:37:57.683637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25354bf0-297a-4341-97cf-b9078600e3f2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.693151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25354bf0-297a-4341-97cf-b9078600e3f2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.697693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.698335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.698620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.698904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.699669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:37:57.699981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.701595 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:57.713391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1168/2343] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:37:57.717895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258774e-abea-40c9-968a-9f6abee766fc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.727011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258774e-abea-40c9-968a-9f6abee766fc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.732243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.732878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.733158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.733435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.734141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.736113 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:57.760555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1176/2344] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:37:57 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:57.765439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.775925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214a80-e9b9-4bc9-957d-e752dc245a1f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.829304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.829981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.830265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.830544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.831268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.833225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:57.857629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1169/2345] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:37:57 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:37:57.861929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.876106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27523e55-6068-464c-8e58-a3534f2e8fc7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.880629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.881304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.881588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.881866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.882621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.884747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:57.903535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1177/2346] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:57.904943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.918860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752ed73-b9c1-481e-aa52-3874cce8389d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.921488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962aa4a-0cc8-48d6-9e75-9ecf90bcd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.922149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962aa4a-0cc8-48d6-9e75-9ecf90bcd6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.922434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962aa4a-0cc8-48d6-9e75-9ecf90bcd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.922713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962aa4a-0cc8-48d6-9e75-9ecf90bcd6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.923482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962aa4a-0cc8-48d6-9e75-9ecf90bcd6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.925101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962aa4a-0cc8-48d6-9e75-9ecf90bcd6d7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:57.935444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1170/2347] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:37:57.939605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:57.953902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebb8e6-2c6f-4087-8680-9c97a10f3e75 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:57.958939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:57.959888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:57.960169 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:57.960449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] PATH_INFO: `/v3/projects/a36697eb438d4c69909c3d32f2f92e77/users/109bd8f590ec434a9cc0326cbc13890a/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:57.978633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36697eb438d4c69909c3d32f2f92e77, user_id=109bd8f590ec434a9cc0326cbc13890a, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:57.981493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:58.002075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1178/2348] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:37:57 2022] PUT /identity/v3/projects/a36697eb438d4c69909c3d32f2f92e77/users/109bd8f590ec434a9cc0326cbc13890a/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:37:58.007168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c196cb2-a608-4509-8cd7-7e76d92d1c1f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:58.007489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c196cb2-a608-4509-8cd7-7e76d92d1c1f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:58.007788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c196cb2-a608-4509-8cd7-7e76d92d1c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:58.027683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-6c196cb2-a608-4509-8cd7-7e76d92d1c1f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:37:58.028877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6c196cb2-a608-4509-8cd7-7e76d92d1c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:58.085516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1171/2349] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:37:58.097006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:37:58.098794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:37:58.159758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615f8db-d098-4861-8356-4daedf24a58f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:37:58.163835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:37:58.165570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:37:58.165974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:37:58.166310 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:37:58.177159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:37:58.178902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:37:58.198573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1179/2350] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:02.275243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd69f5-482d-4cd2-8798-690ffa8f887a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:02.275749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd69f5-482d-4cd2-8798-690ffa8f887a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:02.275964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd69f5-482d-4cd2-8798-690ffa8f887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:02.313625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-88cd69f5-482d-4cd2-8798-690ffa8f887a None None] MFA Rules not processed for user `109bd8f590ec434a9cc0326cbc13890a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:02.314960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-88cd69f5-482d-4cd2-8798-690ffa8f887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:02.405144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1172/2351] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:02.409938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:02.468023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a33e3f-c89d-4aaf-8cb3-b5ef606cdc11 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:02.472701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:02.473370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:02.473683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:02.473962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:02.474677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:02.476637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:02.541206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1180/2352] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:38:02 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:02.542299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd69f5-482d-4cd2-8798-690ffa8f887a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:02.553510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd69f5-482d-4cd2-8798-690ffa8f887a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:02.626600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:02.627279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:02.627587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:02.627868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:02.628575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:02.630493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:02.661664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1173/2353] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:38:02 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:02.662060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:02.676447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25823-624a-4df2-b139-94709399fb0b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:02.681368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:02.683111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:02.683111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:02.683111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:02.683557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:02.685273 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:02.696619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1181/2354] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:38:02.700838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:02.710778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13957d69-4ba8-43f4-b592-d6f45962886b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:02.719312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:02.719897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:02.720187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:02.720479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] PATH_INFO: `/v3/projects/91ef4548605040e9af946d0b43a313bd/users/479cef86bc7e407aa4dddb31be966676/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:02.738194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ef4548605040e9af946d0b43a313bd, user_id=479cef86bc7e407aa4dddb31be966676, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:02.741004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:02.757588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1174/2355] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:02 2022] PUT /identity/v3/projects/91ef4548605040e9af946d0b43a313bd/users/479cef86bc7e407aa4dddb31be966676/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:02.761776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:02.773093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689750-cbf0-4820-bd61-6ae96fcec804 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:02.839296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452641-64ac-402b-b049-78219f2c0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:02.840049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452641-64ac-402b-b049-78219f2c0c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:02.840338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452641-64ac-402b-b049-78219f2c0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:02.840622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452641-64ac-402b-b049-78219f2c0c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:02.841387 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452641-64ac-402b-b049-78219f2c0c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:02.843052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee452641-64ac-402b-b049-78219f2c0c9c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:02.854951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1182/2356] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:02.858915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:02.870918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14fda-0884-4d5c-9f9a-05ceec675a97 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:02.879778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:02.880841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:02.881292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:02.881855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] PATH_INFO: `/v3/projects/91ef4548605040e9af946d0b43a313bd/users/479cef86bc7e407aa4dddb31be966676/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:02.884989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ef4548605040e9af946d0b43a313bd, user_id=479cef86bc7e407aa4dddb31be966676, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:02.887984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:02.900569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1175/2357] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:02 2022] PUT /identity/v3/projects/91ef4548605040e9af946d0b43a313bd/users/479cef86bc7e407aa4dddb31be966676/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:08.207269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:08.207878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:08.207878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:08.252366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] MFA Rules not processed for user `479cef86bc7e407aa4dddb31be966676`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:08.254070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:08.349254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1183/2358] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:08.365253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:08.367075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:08.463128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4efc2e-64ec-4919-b49e-096d9f085133 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:08.469026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06160b58-392f-4ec0-b24e-9129e6da213c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:08.469762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b58-392f-4ec0-b24e-9129e6da213c service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:08.470115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b58-392f-4ec0-b24e-9129e6da213c service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:08.470467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06160b58-392f-4ec0-b24e-9129e6da213c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:08.533970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160b58-392f-4ec0-b24e-9129e6da213c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:08.536695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06160b58-392f-4ec0-b24e-9129e6da213c service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:08.547029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1176/2359] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:38:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:30.234340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:30.235895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:30.326506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff3900-7701-465a-b0b9-fcd10f8e8203 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:30.332241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae70191-d042-4d63-b73a-094871935f05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c7f1498d7e4ef79977166d285e5e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:30.332980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae70191-d042-4d63-b73a-094871935f05 service placement] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:30.333331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae70191-d042-4d63-b73a-094871935f05 service placement] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:30.333673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae70191-d042-4d63-b73a-094871935f05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:30.335507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-aae70191-d042-4d63-b73a-094871935f05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:30.347639 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae70191-d042-4d63-b73a-094871935f05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:30.349240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae70191-d042-4d63-b73a-094871935f05 service placement] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:30.359760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1184/2360] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:38:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:33.238652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f29a41-5ada-43a3-8890-393ff56d08b7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:33.239570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f29a41-5ada-43a3-8890-393ff56d08b7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:33.240037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f29a41-5ada-43a3-8890-393ff56d08b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:33.265538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-86f29a41-5ada-43a3-8890-393ff56d08b7 None None] MFA Rules not processed for user `109bd8f590ec434a9cc0326cbc13890a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:33.266753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-86f29a41-5ada-43a3-8890-393ff56d08b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:33.274074 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1177/2361] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:47.015292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:47.015878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:47.015878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:47.034462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] MFA Rules not processed for user `ee10df6534284c08973b7d11977def60`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:47.035674 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:47.095539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1185/2362] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:52.329684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f29a41-5ada-43a3-8890-393ff56d08b7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:52.410770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f29a41-5ada-43a3-8890-393ff56d08b7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:52.415003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:52.415666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:52.415945 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:52.416220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:52.425490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:52.426865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:52.436823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1178/2363] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:38:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:52.613786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:52.615334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:52.697259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd9246-6ee9-43a4-b67b-065d80476b5d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:52.701831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:52.702736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:52.703020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:52.703296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] PATH_INFO: `/v3/users/93bd2a35edc74582b837a2e76b92bc93` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:52.704772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bd2a35edc74582b837a2e76b92bc93)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:52.706656 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:52.762694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bd2a35edc74582b837a2e76b92bc93'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:52.770239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bd2a35edc74582b837a2e76b92bc93'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:52.777866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bd2a35edc74582b837a2e76b92bc93'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:52.790654 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bd2a35edc74582b837a2e76b92bc93'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:52.791370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2da3816-4531-4fe8-9eb9-8afc047e0d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bd2a35edc74582b837a2e76b92bc93'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:52.797085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1186/2364] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:38:52 2022] DELETE /identity/v3/users/93bd2a35edc74582b837a2e76b92bc93 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:52.988853 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.002835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342528-b3c9-47cc-99dd-5bc18bef16ae service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.066206 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.067066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.067350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.067661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] PATH_INFO: `/v3/projects/f432db4128fd41dcb4533e392be06161` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.068896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f432db4128fd41dcb4533e392be06161)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.070910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.117762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f432db4128fd41dcb4533e392be06161', 'request_id': 'req-77a061ac-cc91-4184-889a-1bf3fe3f7e58'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:53.123823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f432db4128fd41dcb4533e392be06161', 'request_id': 'req-77a061ac-cc91-4184-889a-1bf3fe3f7e58'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:53.129280 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f432db4128fd41dcb4533e392be06161', 'request_id': 'req-77a061ac-cc91-4184-889a-1bf3fe3f7e58'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:53.141623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] The token cache is being invalidate because project f432db4128fd41dcb4533e392be06161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:38:53.142037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:53.142763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-77a061ac-cc91-4184-889a-1bf3fe3f7e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:53.144740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1179/2365] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:38:52 2022] DELETE /identity/v3/projects/f432db4128fd41dcb4533e392be06161 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:53.150557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95be51-932a-4f37-b8e0-29e90fe0590c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.150849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95be51-932a-4f37-b8e0-29e90fe0590c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.151133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95be51-932a-4f37-b8e0-29e90fe0590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.207523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-db95be51-932a-4f37-b8e0-29e90fe0590c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:53.208741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-db95be51-932a-4f37-b8e0-29e90fe0590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:53.283222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1187/2366] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:53.291773 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f70f-7585-4efb-ad37-0a6f73b28901 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.292096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f70f-7585-4efb-ad37-0a6f73b28901 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.292380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f70f-7585-4efb-ad37-0a6f73b28901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.312348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-18c7f70f-7585-4efb-ad37-0a6f73b28901 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:53.313574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-18c7f70f-7585-4efb-ad37-0a6f73b28901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:53.322275 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1180/2367] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:53.326488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95be51-932a-4f37-b8e0-29e90fe0590c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.337544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95be51-932a-4f37-b8e0-29e90fe0590c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.343026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.343909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.344352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.344776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.345685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:38:53.345994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.347623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.361229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1188/2368] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:38:53.365569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f70f-7585-4efb-ad37-0a6f73b28901 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.375088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f70f-7585-4efb-ad37-0a6f73b28901 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.380277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.381003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.381355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.381699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.383003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.385750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.418312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1181/2369] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:38:53 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:53.422172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.432789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16d3b-cb69-4535-a29c-f5435936209f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.501797 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.502623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.502999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.503483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.504211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.506393 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.537741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1189/2370] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:38:53 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:53.541833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.554184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76608-625c-48b6-b63f-47b107fa9bee admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.560921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.561821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.562105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.562440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.563299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.564983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.576506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1182/2371] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:38:53.580685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.590980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec68af-873f-49b0-bc4d-c806cf6f3083 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.595796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838b4c1-7402-424e-a0b9-86395ba74886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.596454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b4c1-7402-424e-a0b9-86395ba74886 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.596742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b4c1-7402-424e-a0b9-86395ba74886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.597024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b4c1-7402-424e-a0b9-86395ba74886 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.597769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838b4c1-7402-424e-a0b9-86395ba74886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.599357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838b4c1-7402-424e-a0b9-86395ba74886 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.609672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1190/2372] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:53.613854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.624481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bdbcc-5d31-45ec-91ab-f8a2addefe2d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.629573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.630448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.630735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.631015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] PATH_INFO: `/v3/projects/89cb870da4064c5682759c227f8ced46/users/8b7adbd087924392aa9a28023b7e4002/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.645318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cb870da4064c5682759c227f8ced46, user_id=8b7adbd087924392aa9a28023b7e4002, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.648051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.662296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1183/2373] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:53 2022] PUT /identity/v3/projects/89cb870da4064c5682759c227f8ced46/users/8b7adbd087924392aa9a28023b7e4002/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:38:53.673759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acc9d7-9198-45cc-9843-153052a8c8d4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.674308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acc9d7-9198-45cc-9843-153052a8c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.674418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acc9d7-9198-45cc-9843-153052a8c8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.701179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-18acc9d7-9198-45cc-9843-153052a8c8d4 None None] MFA Rules not processed for user `8b7adbd087924392aa9a28023b7e4002`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:53.702403 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-18acc9d7-9198-45cc-9843-153052a8c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:53.772136 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1191/2374] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:53.776924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.843124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21e2b-151c-4bb6-9c73-d4dcad2ca49b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.851714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.852551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.852838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.853119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.853858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.855824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.889220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1184/2375] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:38:53 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:53.893763 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acc9d7-9198-45cc-9843-153052a8c8d4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:53.905140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acc9d7-9198-45cc-9843-153052a8c8d4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:53.973497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:53.974250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:53.974535 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:53.974813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:53.975562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:53.977568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:53.998994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1192/2376] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:38:53 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:54.002963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:54.014370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacd2e-c1b1-4f28-98be-4240ccc8ef4c admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:54.019172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:54.019871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:54.020156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:54.020438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:54.021176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:54.023363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:54.034173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1185/2377] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:54.039082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:54.049240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876772f-e523-4ad0-ab13-ccdbb94a2bbd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:54.054117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:54.055003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:54.055295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:54.055632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] PATH_INFO: `/v3/projects/b6f10dd0d2a14e1bbe66d6fea86ae650/users/0d85c9301fb549e59567cf4c20f00b3a/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:54.070370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f10dd0d2a14e1bbe66d6fea86ae650, user_id=0d85c9301fb549e59567cf4c20f00b3a, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:54.073142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:54.094525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1193/2378] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:54 2022] PUT /identity/v3/projects/b6f10dd0d2a14e1bbe66d6fea86ae650/users/0d85c9301fb549e59567cf4c20f00b3a/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:54.098738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:54.116448 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa59e4-eb65-4b97-88b9-3c4e8b130787 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:54.173087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6cb66-8692-42e5-9768-09a7d77aeb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:54.173759 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6cb66-8692-42e5-9768-09a7d77aeb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:54.174047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6cb66-8692-42e5-9768-09a7d77aeb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:54.174329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6cb66-8692-42e5-9768-09a7d77aeb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:54.175071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6cb66-8692-42e5-9768-09a7d77aeb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:54.176755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6cb66-8692-42e5-9768-09a7d77aeb7c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:54.186325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1186/2379] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:54.190709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:54.201302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7599-6210-417b-99f0-f1a5da9501a1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:54.205929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:54.206802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:54.207087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:54.207368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] PATH_INFO: `/v3/projects/b6f10dd0d2a14e1bbe66d6fea86ae650/users/0d85c9301fb549e59567cf4c20f00b3a/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:54.209399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f10dd0d2a14e1bbe66d6fea86ae650, user_id=0d85c9301fb549e59567cf4c20f00b3a, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:54.212651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:54.223422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1194/2380] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:54 2022] PUT /identity/v3/projects/b6f10dd0d2a14e1bbe66d6fea86ae650/users/0d85c9301fb549e59567cf4c20f00b3a/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:54.233508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155173e-0151-4353-a367-bc57fe28291e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:54.233799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155173e-0151-4353-a367-bc57fe28291e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:54.234078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155173e-0151-4353-a367-bc57fe28291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:54.269675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0155173e-0151-4353-a367-bc57fe28291e None None] MFA Rules not processed for user `0d85c9301fb549e59567cf4c20f00b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:54.271907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0155173e-0151-4353-a367-bc57fe28291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:54.353044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1187/2381] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:54.362599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:54.364756 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:54.446142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ae464-b3a1-4cbe-baa3-57affa2bd0b9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:54.449292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88797125-6502-4298-92f9-b3977d517efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:54.450024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797125-6502-4298-92f9-b3977d517efd service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:54.450376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797125-6502-4298-92f9-b3977d517efd service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:54.450730 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88797125-6502-4298-92f9-b3977d517efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:54.460986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797125-6502-4298-92f9-b3977d517efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:54.462994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88797125-6502-4298-92f9-b3977d517efd service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:54.472564 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1195/2382] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:38:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:55.938740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155173e-0151-4353-a367-bc57fe28291e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:56.001930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155173e-0151-4353-a367-bc57fe28291e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:56.006799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:56.007878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:56.008156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:56.008429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] PATH_INFO: `/v3/users/8b7adbd087924392aa9a28023b7e4002` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:56.009657 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7adbd087924392aa9a28023b7e4002)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:56.011598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:56.059779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7adbd087924392aa9a28023b7e4002'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.067287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7adbd087924392aa9a28023b7e4002'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.079607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7adbd087924392aa9a28023b7e4002'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.087478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7adbd087924392aa9a28023b7e4002'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.088079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7adbd087924392aa9a28023b7e4002'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.094337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1188/2383] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:38:55 2022] DELETE /identity/v3/users/8b7adbd087924392aa9a28023b7e4002 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:56.099000 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:56.099499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:56.099712 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:56.118290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:56.119831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:56.178009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1196/2384] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:56.188456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:56.189832 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:56.261687 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93515fcc-e16c-4822-a44f-6a7f71344e47 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:56.265503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:56.266148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:56.266459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:56.266735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:56.276756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:56.278185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:56.287941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1189/2385] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:56.587331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:56.588808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:56.601335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcc261-899c-4a3b-bb1c-7dd54d948c80 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:56.605887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:56.606743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:56.607024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:56.607304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] PATH_INFO: `/v3/projects/89cb870da4064c5682759c227f8ced46` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:56.608562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cb870da4064c5682759c227f8ced46)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:56.610450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:56.656442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cb870da4064c5682759c227f8ced46', 'request_id': 'req-9d05af3c-b20e-4165-b72b-49d217dbd1c0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.664342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cb870da4064c5682759c227f8ced46', 'request_id': 'req-9d05af3c-b20e-4165-b72b-49d217dbd1c0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.669548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cb870da4064c5682759c227f8ced46', 'request_id': 'req-9d05af3c-b20e-4165-b72b-49d217dbd1c0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.680272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] The token cache is being invalidate because project 89cb870da4064c5682759c227f8ced46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:38:56.680557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.681173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.682706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1197/2386] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:38:56 2022] DELETE /identity/v3/projects/89cb870da4064c5682759c227f8ced46 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:56.686747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:56.696498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8014c4-6f98-439a-9511-5d35f041dfb0 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:56.752775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:56.753643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:56.753930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:56.754211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] PATH_INFO: `/v3/users/0d85c9301fb549e59567cf4c20f00b3a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:56.755436 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d85c9301fb549e59567cf4c20f00b3a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:56.758010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:56.801525 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d85c9301fb549e59567cf4c20f00b3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.808674 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d85c9301fb549e59567cf4c20f00b3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.819808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d85c9301fb549e59567cf4c20f00b3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.826734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d85c9301fb549e59567cf4c20f00b3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.827376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-33e37cc4-b544-425c-8724-9e8b7cfee279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d85c9301fb549e59567cf4c20f00b3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:56.833159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1190/2387] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:38:56 2022] DELETE /identity/v3/users/0d85c9301fb549e59567cf4c20f00b3a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:57.118184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.120916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:57.147339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05af3c-b20e-4165-b72b-49d217dbd1c0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.213044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.214093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.214464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.214972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] PATH_INFO: `/v3/projects/b6f10dd0d2a14e1bbe66d6fea86ae650` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.216705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f10dd0d2a14e1bbe66d6fea86ae650)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.218481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.266200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f10dd0d2a14e1bbe66d6fea86ae650', 'request_id': 'req-f210b0e8-d2a2-4981-87ba-91d85f05d45b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:57.274737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f10dd0d2a14e1bbe66d6fea86ae650', 'request_id': 'req-f210b0e8-d2a2-4981-87ba-91d85f05d45b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:57.280905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f10dd0d2a14e1bbe66d6fea86ae650', 'request_id': 'req-f210b0e8-d2a2-4981-87ba-91d85f05d45b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:57.292526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] The token cache is being invalidate because project b6f10dd0d2a14e1bbe66d6fea86ae650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:38:57.292953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:57.293645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f210b0e8-d2a2-4981-87ba-91d85f05d45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:57.295436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1198/2388] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:38:57 2022] DELETE /identity/v3/projects/b6f10dd0d2a14e1bbe66d6fea86ae650 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:57.300890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27d246-7ff8-4aa7-9f25-fc432b46467e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.301360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27d246-7ff8-4aa7-9f25-fc432b46467e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.301454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27d246-7ff8-4aa7-9f25-fc432b46467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.319266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-cd27d246-7ff8-4aa7-9f25-fc432b46467e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:57.321092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-cd27d246-7ff8-4aa7-9f25-fc432b46467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:57.377814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1191/2389] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:57.387431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c64f4-68b0-4ca1-9b9d-b4a0d623d6f3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.387661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c64f4-68b0-4ca1-9b9d-b4a0d623d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.387966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c64f4-68b0-4ca1-9b9d-b4a0d623d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.408196 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-984c64f4-68b0-4ca1-9b9d-b4a0d623d6f3 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:57.409410 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-984c64f4-68b0-4ca1-9b9d-b4a0d623d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:57.417602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1199/2390] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:57.421879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27d246-7ff8-4aa7-9f25-fc432b46467e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.431719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27d246-7ff8-4aa7-9f25-fc432b46467e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.436453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.437111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.437392 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.437670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.438404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:38:57.438719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.440346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.452490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1192/2391] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:38:57.456632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c64f4-68b0-4ca1-9b9d-b4a0d623d6f3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.466189 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c64f4-68b0-4ca1-9b9d-b4a0d623d6f3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.471039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.471728 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.472033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.472309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.473009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.474892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.501591 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1200/2392] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:38:57 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:57.505634 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.515339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e4eb9-110a-4b0c-b1c4-a314574f25bf admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.572696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.573362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.573648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.573953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.574650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.576587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.595692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1193/2393] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:38:57 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:57.599735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.610769 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734a5b-61f8-4761-9d06-ed66c5022b10 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.615318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.615996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.616352 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.616626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.617361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.618938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.628882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1201/2394] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:57.632617 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.642403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de206b8e-a84b-41be-a8ce-be0b0b68a743 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.647029 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97e3bd-7d3e-4c50-95b3-9636414f272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.648228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e3bd-7d3e-4c50-95b3-9636414f272c admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.648512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e3bd-7d3e-4c50-95b3-9636414f272c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.648793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97e3bd-7d3e-4c50-95b3-9636414f272c admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.649527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97e3bd-7d3e-4c50-95b3-9636414f272c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.651106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97e3bd-7d3e-4c50-95b3-9636414f272c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.661104 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1194/2395] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:57.665431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.675096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4f7eb-d8fa-4f8a-a2dd-431701685f75 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.679849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.680717 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.681390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.681390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] PATH_INFO: `/v3/projects/d9fa788a9dcc4d9cb41ee54e198a41bb/users/fdd9541e00654c55b168ca795d1db14f/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.695585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fa788a9dcc4d9cb41ee54e198a41bb, user_id=fdd9541e00654c55b168ca795d1db14f, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.698219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.710903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1202/2396] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:57 2022] PUT /identity/v3/projects/d9fa788a9dcc4d9cb41ee54e198a41bb/users/fdd9541e00654c55b168ca795d1db14f/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:57.721087 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584cd7-91bb-41c6-b71c-91ad4d0a28e0 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.721376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584cd7-91bb-41c6-b71c-91ad4d0a28e0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.721718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584cd7-91bb-41c6-b71c-91ad4d0a28e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.748302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-30584cd7-91bb-41c6-b71c-91ad4d0a28e0 None None] MFA Rules not processed for user `fdd9541e00654c55b168ca795d1db14f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:57.749618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-30584cd7-91bb-41c6-b71c-91ad4d0a28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:57.810359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1195/2397] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:57.814872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.880320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d9613-6d2e-42b0-bf68-ceac4cb35963 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.885478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.886142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.886428 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.886708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.887460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.889350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:57.915427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1203/2398] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:38:57 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:57.919411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584cd7-91bb-41c6-b71c-91ad4d0a28e0 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:57.929908 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584cd7-91bb-41c6-b71c-91ad4d0a28e0 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:57.983378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:57.984077 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:57.984367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:57.984651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:57.985794 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:57.987780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.007793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1196/2399] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:38:57 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:38:58.011724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:58.021626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac98eca-677a-4e22-bf6b-8c4472efb835 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:58.026142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:58.026793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.027081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.027363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.028140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:58.029993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.040529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1204/2400] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:58.044340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:58.054532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82318a-3bec-46de-8dab-86b89dce387d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:58.059102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:58.060005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.060282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.060557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] PATH_INFO: `/v3/projects/44967b0902e24eb682f915c14f50732e/users/2bc822c167b64bc99a177eb18efaffab/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.074808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44967b0902e24eb682f915c14f50732e, user_id=2bc822c167b64bc99a177eb18efaffab, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:58.077475 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.089648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1197/2401] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:58 2022] PUT /identity/v3/projects/44967b0902e24eb682f915c14f50732e/users/2bc822c167b64bc99a177eb18efaffab/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:58.093554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:58.103861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358de4c-0d27-462f-bdba-b04c2786c52b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:58.164822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021333b4-7a31-4bb3-ad54-b81cfe787b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:58.165536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021333b4-7a31-4bb3-ad54-b81cfe787b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.165747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021333b4-7a31-4bb3-ad54-b81cfe787b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.166020 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021333b4-7a31-4bb3-ad54-b81cfe787b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.166764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021333b4-7a31-4bb3-ad54-b81cfe787b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:58.168361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021333b4-7a31-4bb3-ad54-b81cfe787b65 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.177748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1205/2402] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:38:58.182565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:58.192443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9037b-a3f9-4ac4-9ac0-1792f3cba0d8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:58.197278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:58.198179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.198523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.198805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] PATH_INFO: `/v3/projects/44967b0902e24eb682f915c14f50732e/users/2bc822c167b64bc99a177eb18efaffab/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.200819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=44967b0902e24eb682f915c14f50732e, user_id=2bc822c167b64bc99a177eb18efaffab, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:58.203553 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.213470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1198/2403] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:38:58 2022] PUT /identity/v3/projects/44967b0902e24eb682f915c14f50732e/users/2bc822c167b64bc99a177eb18efaffab/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:58.223281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d89f-e655-4b67-bdef-81c5dac21926 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.223607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d89f-e655-4b67-bdef-81c5dac21926 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.223895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d89f-e655-4b67-bdef-81c5dac21926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.250091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-54a4d89f-e655-4b67-bdef-81c5dac21926 None None] MFA Rules not processed for user `2bc822c167b64bc99a177eb18efaffab`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:58.251286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-54a4d89f-e655-4b67-bdef-81c5dac21926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:58.316750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1206/2404] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:58.327233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:58.328931 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:58.384200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac96a6-3e6d-487d-9570-0a5e44200cec admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:58.387841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69b565-47a0-4bde-b2db-1b4d4377f0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:58.388488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b565-47a0-4bde-b2db-1b4d4377f0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.388777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b565-47a0-4bde-b2db-1b4d4377f0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.389057 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b565-47a0-4bde-b2db-1b4d4377f0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.398881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69b565-47a0-4bde-b2db-1b4d4377f0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:58.400346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69b565-47a0-4bde-b2db-1b4d4377f0c2 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.414079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1199/2405] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:38:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:58.440248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d89f-e655-4b67-bdef-81c5dac21926 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:58.502540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d89f-e655-4b67-bdef-81c5dac21926 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:58.509617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:58.511061 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.512805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.513111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] PATH_INFO: `/v3/users/fdd9541e00654c55b168ca795d1db14f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.515334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd9541e00654c55b168ca795d1db14f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:58.517293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.563212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd9541e00654c55b168ca795d1db14f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:58.571883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd9541e00654c55b168ca795d1db14f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:58.579116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd9541e00654c55b168ca795d1db14f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:58.590329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd9541e00654c55b168ca795d1db14f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:58.591076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd9541e00654c55b168ca795d1db14f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:58.596960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1207/2406] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:38:58 2022] DELETE /identity/v3/users/fdd9541e00654c55b168ca795d1db14f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:58.602096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.602390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.602668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.621336 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:58.622556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:58.686179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1200/2407] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:58.692887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:58.694838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:58.752694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38afb-2025-407a-a7a5-aed36c34d98c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:58.757626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:58.758289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:58.758576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:58.758858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:58.768625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:58.770066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:58.780252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1208/2408] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:38:59.048366 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:59.049838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:59.062663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04417f6-10bb-4a90-adee-60256e2ec709 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:59.067578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:59.073873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.074168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.074451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] PATH_INFO: `/v3/projects/d9fa788a9dcc4d9cb41ee54e198a41bb` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.075726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fa788a9dcc4d9cb41ee54e198a41bb)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:59.077653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:59.122808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fa788a9dcc4d9cb41ee54e198a41bb', 'request_id': 'req-4f8b089a-b020-4a21-bc39-c90b74b0ddce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.128819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fa788a9dcc4d9cb41ee54e198a41bb', 'request_id': 'req-4f8b089a-b020-4a21-bc39-c90b74b0ddce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.134165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fa788a9dcc4d9cb41ee54e198a41bb', 'request_id': 'req-4f8b089a-b020-4a21-bc39-c90b74b0ddce'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.145944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] The token cache is being invalidate because project d9fa788a9dcc4d9cb41ee54e198a41bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:38:59.146230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.146836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.148941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1201/2409] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:38:59 2022] DELETE /identity/v3/projects/d9fa788a9dcc4d9cb41ee54e198a41bb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:59.153007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:59.162704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f300c-ae59-451b-8683-084f755bc76a service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:59.216675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:59.217471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.217757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.218034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] PATH_INFO: `/v3/users/2bc822c167b64bc99a177eb18efaffab` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.219236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc822c167b64bc99a177eb18efaffab)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:59.221199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:59.265356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc822c167b64bc99a177eb18efaffab'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.271370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc822c167b64bc99a177eb18efaffab'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.278384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc822c167b64bc99a177eb18efaffab'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.290337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc822c167b64bc99a177eb18efaffab'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.290970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5f15964c-1000-4093-9241-ce9e6fd54bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc822c167b64bc99a177eb18efaffab'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.296606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1209/2410] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:38:59 2022] DELETE /identity/v3/users/2bc822c167b64bc99a177eb18efaffab => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:59.552022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:59.553577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:59.570476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b089a-b020-4a21-bc39-c90b74b0ddce admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:59.628827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:59.629711 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.629992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.630268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] PATH_INFO: `/v3/projects/44967b0902e24eb682f915c14f50732e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.631466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=44967b0902e24eb682f915c14f50732e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:59.633414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:59.676779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44967b0902e24eb682f915c14f50732e', 'request_id': 'req-016f345f-1fb1-4bd0-844a-84078202cf9d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.683202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44967b0902e24eb682f915c14f50732e', 'request_id': 'req-016f345f-1fb1-4bd0-844a-84078202cf9d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.688589 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44967b0902e24eb682f915c14f50732e', 'request_id': 'req-016f345f-1fb1-4bd0-844a-84078202cf9d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.700860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] The token cache is being invalidate because project 44967b0902e24eb682f915c14f50732e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:38:59.701144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.701750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-016f345f-1fb1-4bd0-844a-84078202cf9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:38:59.703305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1202/2411] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:38:59 2022] DELETE /identity/v3/projects/44967b0902e24eb682f915c14f50732e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:38:59.709042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabc913-0849-45b6-b336-794ded9d94a0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.709327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabc913-0849-45b6-b336-794ded9d94a0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.709607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabc913-0849-45b6-b336-794ded9d94a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.727156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0dabc913-0849-45b6-b336-794ded9d94a0 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:59.728306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0dabc913-0849-45b6-b336-794ded9d94a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:59.791033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1210/2412] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:38:59.799545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5056f5-027a-4acf-8450-1ab30f8ae8a4 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.799837 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5056f5-027a-4acf-8450-1ab30f8ae8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.800123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5056f5-027a-4acf-8450-1ab30f8ae8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.817969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0a5056f5-027a-4acf-8450-1ab30f8ae8a4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:38:59.819213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0a5056f5-027a-4acf-8450-1ab30f8ae8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:38:59.827363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1203/2413] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:38:59.831573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabc913-0849-45b6-b336-794ded9d94a0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:59.841617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabc913-0849-45b6-b336-794ded9d94a0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:59.846229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:59.846887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.847166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.847463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.848214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:38:59.848519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:59.850118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:59.862498 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1211/2414] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:38:59.866885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5056f5-027a-4acf-8450-1ab30f8ae8a4 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:59.878522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5056f5-027a-4acf-8450-1ab30f8ae8a4 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:59.883267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:59.883947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.884305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.884495 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.885261 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:59.887126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:38:59.913320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1204/2415] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:38:59 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:38:59.917116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:38:59.926951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef14b-3cd6-4a3e-9f20-83c9e2e845b6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:38:59.984200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:38:59.984870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:38:59.985177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:38:59.985456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:38:59.986215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:38:59.988414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.009816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1212/2416] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:38:59 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:39:00.013970 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.024145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4a599-1406-4462-be87-341a98b7d7ae admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.029052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.029711 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.029998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.030278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.031017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.032886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.043707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1205/2417] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:00.048038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.060141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddc258-5a95-49a7-9bfa-3dcbef8cfd25 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.066511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7c24-274b-4433-a9d1-3a8b66ddbcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.067170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c24-274b-4433-a9d1-3a8b66ddbcbc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.067482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c24-274b-4433-a9d1-3a8b66ddbcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.067760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7c24-274b-4433-a9d1-3a8b66ddbcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.068494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7c24-274b-4433-a9d1-3a8b66ddbcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.070636 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7c24-274b-4433-a9d1-3a8b66ddbcbc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.081021 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1213/2418] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:00.085241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.094991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c59b48-194c-44ab-a831-ff902b83ea11 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.100403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.101825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.102160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.102387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] PATH_INFO: `/v3/projects/8cb6248ddb0745ecac571c5e736bf771/users/1e9ceb567f764b52815fbd27b0c06ff7/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.119909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb6248ddb0745ecac571c5e736bf771, user_id=1e9ceb567f764b52815fbd27b0c06ff7, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.122572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.137737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1206/2419] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:00 2022] PUT /identity/v3/projects/8cb6248ddb0745ecac571c5e736bf771/users/1e9ceb567f764b52815fbd27b0c06ff7/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:00.148601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c4c7-66ca-4e33-916b-2692af703a20 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.148883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c4c7-66ca-4e33-916b-2692af703a20 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.149319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c4c7-66ca-4e33-916b-2692af703a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.178755 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0433c4c7-66ca-4e33-916b-2692af703a20 None None] MFA Rules not processed for user `1e9ceb567f764b52815fbd27b0c06ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:00.180707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0433c4c7-66ca-4e33-916b-2692af703a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:00.249339 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1214/2420] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:00.253808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.315610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320bb36-7dc6-42f7-a25d-3ad0a6c5dc51 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.321131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.321791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.322079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.322364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.323070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.325013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.350244 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1207/2421] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:00 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:00.354167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c4c7-66ca-4e33-916b-2692af703a20 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.364713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c4c7-66ca-4e33-916b-2692af703a20 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.418151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.418804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.419086 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.419413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.420115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.422001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.440752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1215/2422] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:00 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:00.445115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.455671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef173c-1259-4368-83ba-9f833035c7ea admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.460933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.461599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.461886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.462318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.463059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.464723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.475281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1208/2423] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:00.479532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.490962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c35194-0423-4192-a3f8-5c9c135e234b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.496238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c610c-1b03-4238-8238-5a6cdbe7375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.496956 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c610c-1b03-4238-8238-5a6cdbe7375d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.497240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c610c-1b03-4238-8238-5a6cdbe7375d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.497517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c610c-1b03-4238-8238-5a6cdbe7375d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.498263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c610c-1b03-4238-8238-5a6cdbe7375d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.499940 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c610c-1b03-4238-8238-5a6cdbe7375d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.512851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1216/2424] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:00.518345 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.533053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fa656-ccbb-4921-b389-f465b26258e0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.537783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.538678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.538964 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.539245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] PATH_INFO: `/v3/projects/3175fcf764c944c08fd777ed5750f488/users/d39d2598b88c497583e944cbc1435618/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.554350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3175fcf764c944c08fd777ed5750f488, user_id=d39d2598b88c497583e944cbc1435618, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.557004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.571276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1209/2425] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:00 2022] PUT /identity/v3/projects/3175fcf764c944c08fd777ed5750f488/users/d39d2598b88c497583e944cbc1435618/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:00.583142 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1571a-cce4-4e6d-a3a6-d30ea3f7f5ed None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.583462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1571a-cce4-4e6d-a3a6-d30ea3f7f5ed None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.583751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1571a-cce4-4e6d-a3a6-d30ea3f7f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.611260 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-13e1571a-cce4-4e6d-a3a6-d30ea3f7f5ed None None] MFA Rules not processed for user `d39d2598b88c497583e944cbc1435618`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:00.612569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-13e1571a-cce4-4e6d-a3a6-d30ea3f7f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:00.686040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1217/2426] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:00.691031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.768518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c293ee-487e-49a4-b138-e554498c5882 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.775202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.775957 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.776259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.776535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.777584 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.779902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.818293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1210/2427] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:00 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:00.822787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1571a-cce4-4e6d-a3a6-d30ea3f7f5ed None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.833789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1571a-cce4-4e6d-a3a6-d30ea3f7f5ed None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.891490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.892259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.892614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.892969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.893783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.895815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.924844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1218/2428] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:00 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:00.929578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.941941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52239b-b4cc-45b3-9132-631b5c186a56 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.948664 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.949775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.950273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.950743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:00.951638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:00.955684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:00.973019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1211/2429] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:00.974343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:00.986895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca763560-eb33-46ea-87b6-657ddce60ef2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:00.993146 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:00.994034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:00.994345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:00.994967 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] PATH_INFO: `/v3/projects/04a486a29404488a9318645447a6f809/users/5d6453ff5df34999ae0e73441b87b381/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:01.011700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a486a29404488a9318645447a6f809, user_id=5d6453ff5df34999ae0e73441b87b381, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:01.014666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:01.031117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1219/2430] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:00 2022] PUT /identity/v3/projects/04a486a29404488a9318645447a6f809/users/5d6453ff5df34999ae0e73441b87b381/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:01.035079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:01.047242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a6ba4-47a0-42bb-b0cc-65b470d68dfc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:01.109068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39ba9c-ca94-48e5-8d1c-3806a8b185e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:01.109344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ba9c-ca94-48e5-8d1c-3806a8b185e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:01.109579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ba9c-ca94-48e5-8d1c-3806a8b185e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:01.109863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39ba9c-ca94-48e5-8d1c-3806a8b185e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:01.110760 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39ba9c-ca94-48e5-8d1c-3806a8b185e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:01.112455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39ba9c-ca94-48e5-8d1c-3806a8b185e0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:01.122364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1212/2431] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:39:01.126499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:01.137426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf163c-ab7e-453a-9505-182329742d14 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:01.142127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:01.142999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:01.143282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:01.143596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] PATH_INFO: `/v3/projects/04a486a29404488a9318645447a6f809/users/5d6453ff5df34999ae0e73441b87b381/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:01.145645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a486a29404488a9318645447a6f809, user_id=5d6453ff5df34999ae0e73441b87b381, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:01.148895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:01.159177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1220/2432] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:01 2022] PUT /identity/v3/projects/04a486a29404488a9318645447a6f809/users/5d6453ff5df34999ae0e73441b87b381/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:01.169037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d73de-45a2-4737-8f87-4394af50957f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:01.169331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d73de-45a2-4737-8f87-4394af50957f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:01.169610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d73de-45a2-4737-8f87-4394af50957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:01.195873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-345d73de-45a2-4737-8f87-4394af50957f None None] MFA Rules not processed for user `5d6453ff5df34999ae0e73441b87b381`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:01.197099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-345d73de-45a2-4737-8f87-4394af50957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:01.263650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1213/2433] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:01.272901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:01.274600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:01.329009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6fe48-d3b0-431a-ac8d-fffd1d6e8c81 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:01.332617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:01.333252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:01.333532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:01.333809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:01.342527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:01.343980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:01.353078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1221/2434] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:01.801044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d73de-45a2-4737-8f87-4394af50957f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:01.802414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-345d73de-45a2-4737-8f87-4394af50957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:01.813948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d73de-45a2-4737-8f87-4394af50957f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:01.817665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:01.818309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:01.818594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:01.818875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:01.884755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:01.886237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:01.895229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1214/2435] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:05.815637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:05.824010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32e481-ce86-4a5f-8197-771d23132466 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:05.827670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce40d61-1543-47e5-8e78-b6839a15eb73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:05.828302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40d61-1543-47e5-8e78-b6839a15eb73 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:05.828584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40d61-1543-47e5-8e78-b6839a15eb73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:05.828861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40d61-1543-47e5-8e78-b6839a15eb73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:05.883620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce40d61-1543-47e5-8e78-b6839a15eb73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:05.885052 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce40d61-1543-47e5-8e78-b6839a15eb73 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:05.893594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1222/2436] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:07.880245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:07.945612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1f45-799a-4a1d-9f80-94575adcb6e4 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:07.950176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:07.951037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:07.951318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:07.951629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] PATH_INFO: `/v3/users/1e9ceb567f764b52815fbd27b0c06ff7` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:07.952895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9ceb567f764b52815fbd27b0c06ff7)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:07.954844 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:08.001368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9ceb567f764b52815fbd27b0c06ff7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.007933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9ceb567f764b52815fbd27b0c06ff7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.019180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9ceb567f764b52815fbd27b0c06ff7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.026926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9ceb567f764b52815fbd27b0c06ff7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.027569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9ceb567f764b52815fbd27b0c06ff7'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.033451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1215/2437] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:07 2022] DELETE /identity/v3/users/1e9ceb567f764b52815fbd27b0c06ff7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:08.038520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:08.038979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:08.039071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:08.056308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:08.057496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:08.114713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1223/2438] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:08.124166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:08.125619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:08.180905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87182-8611-44da-b04e-94a64baff355 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:08.184565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:08.185202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:08.185483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:08.185758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:08.194546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:08.196021 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:08.204998 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1216/2439] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:08.464034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:08.465646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:08.477470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349cbf0-c088-415a-bab5-a2e497b38025 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:08.482277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:08.483130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:08.483429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:08.483706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] PATH_INFO: `/v3/projects/8cb6248ddb0745ecac571c5e736bf771` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:08.484890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb6248ddb0745ecac571c5e736bf771)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:08.486799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:08.532743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb6248ddb0745ecac571c5e736bf771', 'request_id': 'req-99cd08a2-4bf6-4fa8-b227-62a93a82b233'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.539667 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb6248ddb0745ecac571c5e736bf771', 'request_id': 'req-99cd08a2-4bf6-4fa8-b227-62a93a82b233'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.545046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb6248ddb0745ecac571c5e736bf771', 'request_id': 'req-99cd08a2-4bf6-4fa8-b227-62a93a82b233'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.555642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] The token cache is being invalidate because project 8cb6248ddb0745ecac571c5e736bf771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:08.555925 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.556547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.558050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1224/2440] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:08 2022] DELETE /identity/v3/projects/8cb6248ddb0745ecac571c5e736bf771 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:39:08.561976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:08.572449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c63521-dd1b-4a1c-88a4-b94b6b724cfe service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:08.629099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:08.629951 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:08.630230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:08.630498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] PATH_INFO: `/v3/users/d39d2598b88c497583e944cbc1435618` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:08.631707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39d2598b88c497583e944cbc1435618)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:08.633614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:08.677792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39d2598b88c497583e944cbc1435618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.684922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39d2598b88c497583e944cbc1435618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.696304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39d2598b88c497583e944cbc1435618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.703698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39d2598b88c497583e944cbc1435618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.704444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39d2598b88c497583e944cbc1435618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:08.710276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1217/2441] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:08 2022] DELETE /identity/v3/users/d39d2598b88c497583e944cbc1435618 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:39:08.977645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:08.979540 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:08.992665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd08a2-4bf6-4fa8-b227-62a93a82b233 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:09.049005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:09.049979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.050300 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.050580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] PATH_INFO: `/v3/projects/3175fcf764c944c08fd777ed5750f488` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.051811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3175fcf764c944c08fd777ed5750f488)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:09.053834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:09.099687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3175fcf764c944c08fd777ed5750f488', 'request_id': 'req-0250cbcf-ec9e-411a-a149-76976b417655'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.107986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3175fcf764c944c08fd777ed5750f488', 'request_id': 'req-0250cbcf-ec9e-411a-a149-76976b417655'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.113552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3175fcf764c944c08fd777ed5750f488', 'request_id': 'req-0250cbcf-ec9e-411a-a149-76976b417655'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.124533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] The token cache is being invalidate because project 3175fcf764c944c08fd777ed5750f488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:09.124820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.125471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.127135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1225/2442] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:08 2022] DELETE /identity/v3/projects/3175fcf764c944c08fd777ed5750f488 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:09.131039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:09.133127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:09.145505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8fe6-b736-4b3f-8175-c1b0bdab0157 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:09.205149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:09.206018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.206302 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.206610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] PATH_INFO: `/v3/users/5d6453ff5df34999ae0e73441b87b381` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.207810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6453ff5df34999ae0e73441b87b381)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:09.211726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:09.258654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6453ff5df34999ae0e73441b87b381'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.265137 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6453ff5df34999ae0e73441b87b381'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.277327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6453ff5df34999ae0e73441b87b381'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.284745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6453ff5df34999ae0e73441b87b381'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.285510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ff3eca9-9050-4c20-8fc4-7ea7a1271b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6453ff5df34999ae0e73441b87b381'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.291120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1218/2443] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:09 2022] DELETE /identity/v3/users/5d6453ff5df34999ae0e73441b87b381 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:09.545526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:09.547420 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:09.564697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250cbcf-ec9e-411a-a149-76976b417655 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:09.620081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:09.620927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.621208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.621484 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] PATH_INFO: `/v3/projects/04a486a29404488a9318645447a6f809` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.622650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a486a29404488a9318645447a6f809)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:09.624569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:09.667758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a486a29404488a9318645447a6f809', 'request_id': 'req-d2002638-a6b3-49f9-a2cd-8b10385da109'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.674733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a486a29404488a9318645447a6f809', 'request_id': 'req-d2002638-a6b3-49f9-a2cd-8b10385da109'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.680741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a486a29404488a9318645447a6f809', 'request_id': 'req-d2002638-a6b3-49f9-a2cd-8b10385da109'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.691152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] The token cache is being invalidate because project 04a486a29404488a9318645447a6f809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:09.691472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.692107 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d2002638-a6b3-49f9-a2cd-8b10385da109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:09.693645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1226/2444] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:09 2022] DELETE /identity/v3/projects/04a486a29404488a9318645447a6f809 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:09.701227 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ef4c-6025-43fa-ad6a-04a39f45ebd7 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.701521 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ef4c-6025-43fa-ad6a-04a39f45ebd7 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.701804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ef4c-6025-43fa-ad6a-04a39f45ebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.721061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-7b01ef4c-6025-43fa-ad6a-04a39f45ebd7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:09.722269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7b01ef4c-6025-43fa-ad6a-04a39f45ebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:09.783304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1219/2445] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:09.791500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3e9b-48ff-49dd-bdfd-30d3721d7c38 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.791734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3e9b-48ff-49dd-bdfd-30d3721d7c38 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.792148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a3e9b-48ff-49dd-bdfd-30d3721d7c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.810901 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-924a3e9b-48ff-49dd-bdfd-30d3721d7c38 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:09.812137 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-924a3e9b-48ff-49dd-bdfd-30d3721d7c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:09.820577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1227/2446] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:09.824576 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01ef4c-6025-43fa-ad6a-04a39f45ebd7 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:09.834018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01ef4c-6025-43fa-ad6a-04a39f45ebd7 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:09.838541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:09.839182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.839568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.839850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.840582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:39:09.840886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:09.842488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:09.854427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1220/2447] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:39:09.858642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a3e9b-48ff-49dd-bdfd-30d3721d7c38 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:09.868394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a3e9b-48ff-49dd-bdfd-30d3721d7c38 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:09.873571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:09.873732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.874018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.874296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.875011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:09.876959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:09.907321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1228/2448] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:09 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:09.911266 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:09.921437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd559ef-0bc6-4112-92d9-bcc9abee88cb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:09.974817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:09.976010 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:09.976289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:09.976563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:09.977256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:09.979152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:09.997975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1221/2449] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:09 2022] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:39:10.001974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.012047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12efc6-b276-4852-80d9-0e333be402b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.016609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.017252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.017531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.017806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.018533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.020157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.030345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1229/2450] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:10.033962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.044000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48309-b83f-4db2-991e-0824848f4d42 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.048788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715b6d-25c9-4809-a17f-c0f4bda67e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.049418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715b6d-25c9-4809-a17f-c0f4bda67e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.049699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715b6d-25c9-4809-a17f-c0f4bda67e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.049975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715b6d-25c9-4809-a17f-c0f4bda67e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.050695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715b6d-25c9-4809-a17f-c0f4bda67e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.052296 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715b6d-25c9-4809-a17f-c0f4bda67e1e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.062281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1222/2451] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:10.066022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.076117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031ce25-a562-4eed-a7a2-086890f1817d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.080742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.081598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.081878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.082153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] PATH_INFO: `/v3/projects/ad419e563ff444debd88aa519299e2fa/users/760eaef1f0724f86b037ca8d3cd279a0/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.095903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad419e563ff444debd88aa519299e2fa, user_id=760eaef1f0724f86b037ca8d3cd279a0, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.098505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.112128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1230/2452] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:10 2022] PUT /identity/v3/projects/ad419e563ff444debd88aa519299e2fa/users/760eaef1f0724f86b037ca8d3cd279a0/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:39:10.124656 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322f6d-ac8c-4d85-befa-e5001fa5d89e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.124949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322f6d-ac8c-4d85-befa-e5001fa5d89e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.125230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322f6d-ac8c-4d85-befa-e5001fa5d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.150632 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-fb322f6d-ac8c-4d85-befa-e5001fa5d89e None None] MFA Rules not processed for user `760eaef1f0724f86b037ca8d3cd279a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:10.151859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fb322f6d-ac8c-4d85-befa-e5001fa5d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:10.213387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1223/2453] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:10.217857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.277447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a223-856a-49ed-b558-56878afb9a8b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.283358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.284039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.284317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.284628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.285324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.287194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.313015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1231/2454] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:10 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:10.317046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322f6d-ac8c-4d85-befa-e5001fa5d89e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.327348 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322f6d-ac8c-4d85-befa-e5001fa5d89e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.385069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.385735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.386018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.386298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.387008 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.388941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.408581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1224/2455] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:10 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:10.412569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.422530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09740473-a2f5-4075-bf07-c0118da2ab5d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.427122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.427814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.428621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.428891 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.429628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.431226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.441288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1232/2456] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:39:10.445700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.455274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce2c8f-fcc2-458c-9047-b6665a5359fb admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.459997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.460855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.461141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.461421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] PATH_INFO: `/v3/projects/90136e85c7f8455a9c930e134206c9b2/users/b99a78225e7b48caa8f30c3bfb03a603/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.475508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90136e85c7f8455a9c930e134206c9b2, user_id=b99a78225e7b48caa8f30c3bfb03a603, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.478467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.491907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1225/2457] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:10 2022] PUT /identity/v3/projects/90136e85c7f8455a9c930e134206c9b2/users/b99a78225e7b48caa8f30c3bfb03a603/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:39:10.495469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.505220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36407397-59e1-423f-81f5-1764461c131d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.557834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171540b-4a11-48da-933e-e3d3c68e3a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.558488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171540b-4a11-48da-933e-e3d3c68e3a95 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.558770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171540b-4a11-48da-933e-e3d3c68e3a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.559045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171540b-4a11-48da-933e-e3d3c68e3a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.559800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171540b-4a11-48da-933e-e3d3c68e3a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.561426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171540b-4a11-48da-933e-e3d3c68e3a95 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.571665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1233/2458] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:10.575734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.585983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99d5df-ecf7-4f06-9568-6ed6fabcf732 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.590465 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.591311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.591616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.591894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] PATH_INFO: `/v3/projects/90136e85c7f8455a9c930e134206c9b2/users/b99a78225e7b48caa8f30c3bfb03a603/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.593920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90136e85c7f8455a9c930e134206c9b2, user_id=b99a78225e7b48caa8f30c3bfb03a603, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.596550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.606915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1226/2459] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:10 2022] PUT /identity/v3/projects/90136e85c7f8455a9c930e134206c9b2/users/b99a78225e7b48caa8f30c3bfb03a603/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:39:10.617406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa77b-3b7b-4d98-8ee4-85e32e8c14c7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.617698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa77b-3b7b-4d98-8ee4-85e32e8c14c7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.617974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa77b-3b7b-4d98-8ee4-85e32e8c14c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.644695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f90fa77b-3b7b-4d98-8ee4-85e32e8c14c7 None None] MFA Rules not processed for user `b99a78225e7b48caa8f30c3bfb03a603`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:10.645885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f90fa77b-3b7b-4d98-8ee4-85e32e8c14c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:10.710782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1234/2460] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:10.720155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:10.721947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:10.779526 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2e56-5aec-4988-ba0b-a4317323b783 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:10.783537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ae202-b5f2-4612-aaab-c2ccb68dcbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:10.784180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae202-b5f2-4612-aaab-c2ccb68dcbbd service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:10.784467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae202-b5f2-4612-aaab-c2ccb68dcbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:10.784750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ae202-b5f2-4612-aaab-c2ccb68dcbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:10.794163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ae202-b5f2-4612-aaab-c2ccb68dcbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:10.795631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ae202-b5f2-4612-aaab-c2ccb68dcbbd service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:10.805541 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1227/2461] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:11.278307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa77b-3b7b-4d98-8ee4-85e32e8c14c7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:11.338568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa77b-3b7b-4d98-8ee4-85e32e8c14c7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:11.343040 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:11.343943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:11.344230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:11.344509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] PATH_INFO: `/v3/users/760eaef1f0724f86b037ca8d3cd279a0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:11.345726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=760eaef1f0724f86b037ca8d3cd279a0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:11.347664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:11.393011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760eaef1f0724f86b037ca8d3cd279a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:11.404151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760eaef1f0724f86b037ca8d3cd279a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:11.412644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760eaef1f0724f86b037ca8d3cd279a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:11.423960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760eaef1f0724f86b037ca8d3cd279a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:11.424684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760eaef1f0724f86b037ca8d3cd279a0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:11.431160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1235/2462] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:11 2022] DELETE /identity/v3/users/760eaef1f0724f86b037ca8d3cd279a0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:11.435704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:11.436838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:11.437522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:11.456928 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:11.458005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:11.516867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1228/2463] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:39:11.526785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:11.528247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:11.589505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510123a-193b-4ddc-b5d4-78f41dd24659 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:11.593817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:11.594471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:11.594753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:11.595036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:11.607440 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:11.609053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:11.618979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1236/2464] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:39:11.980048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:11.981677 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:11.996501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e699cbc-2484-4711-8111-8091d6d4e7ea None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:12.007538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:12.008418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:12.008704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:12.009047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] PATH_INFO: `/v3/projects/ad419e563ff444debd88aa519299e2fa` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:12.010239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad419e563ff444debd88aa519299e2fa)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:12.012191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:12.098909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad419e563ff444debd88aa519299e2fa', 'request_id': 'req-c673b4fc-b5f4-4685-8f71-260c8edae99a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.108627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad419e563ff444debd88aa519299e2fa', 'request_id': 'req-c673b4fc-b5f4-4685-8f71-260c8edae99a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.121459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad419e563ff444debd88aa519299e2fa', 'request_id': 'req-c673b4fc-b5f4-4685-8f71-260c8edae99a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.137726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] The token cache is being invalidate because project ad419e563ff444debd88aa519299e2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:12.138028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.138830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.140724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1229/2465] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:11 2022] DELETE /identity/v3/projects/ad419e563ff444debd88aa519299e2fa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:12.144666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:12.155834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf2863-e972-4d8c-a403-d24e54fbc8bf service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:12.211107 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:12.211999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:12.212284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:12.212560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] PATH_INFO: `/v3/users/b99a78225e7b48caa8f30c3bfb03a603` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:12.213753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99a78225e7b48caa8f30c3bfb03a603)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:12.215681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:12.262668 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99a78225e7b48caa8f30c3bfb03a603'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.269791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99a78225e7b48caa8f30c3bfb03a603'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.276895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99a78225e7b48caa8f30c3bfb03a603'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.288772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99a78225e7b48caa8f30c3bfb03a603'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.289518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e0c0a036-2927-46da-92d2-6ce7bf7bd82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99a78225e7b48caa8f30c3bfb03a603'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.295424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1237/2466] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:12 2022] DELETE /identity/v3/users/b99a78225e7b48caa8f30c3bfb03a603 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:12.554738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:12.559552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:12.585309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b4fc-b5f4-4685-8f71-260c8edae99a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:12.652700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:12.654042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:12.654357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:12.654633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] PATH_INFO: `/v3/projects/90136e85c7f8455a9c930e134206c9b2` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:12.655882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90136e85c7f8455a9c930e134206c9b2)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:12.657796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:12.705644 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90136e85c7f8455a9c930e134206c9b2', 'request_id': 'req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.712350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90136e85c7f8455a9c930e134206c9b2', 'request_id': 'req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.717722 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90136e85c7f8455a9c930e134206c9b2', 'request_id': 'req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.730967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] The token cache is being invalidate because project 90136e85c7f8455a9c930e134206c9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:12.731252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.731916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c9a4a757-6c72-4fc3-b71c-25ddaad88e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:12.733450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1230/2467] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:12 2022] DELETE /identity/v3/projects/90136e85c7f8455a9c930e134206c9b2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:12.741138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d0ce-fae7-463e-857a-53eb0b52f5c7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:12.741504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d0ce-fae7-463e-857a-53eb0b52f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:12.741890 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d0ce-fae7-463e-857a-53eb0b52f5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:12.761203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ce47d0ce-fae7-463e-857a-53eb0b52f5c7 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:12.762504 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ce47d0ce-fae7-463e-857a-53eb0b52f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:12.821433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1238/2468] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:39:12.830028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcea38-072d-4335-883b-cda6a300a170 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:12.830316 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcea38-072d-4335-883b-cda6a300a170 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:12.830596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcea38-072d-4335-883b-cda6a300a170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:12.850464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-37fcea38-072d-4335-883b-cda6a300a170 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:12.851653 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-37fcea38-072d-4335-883b-cda6a300a170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:12.859374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1231/2469] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:12.863632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47d0ce-fae7-463e-857a-53eb0b52f5c7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:12.873291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47d0ce-fae7-463e-857a-53eb0b52f5c7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:12.877922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:12.878583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:12.878869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:12.879152 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:12.879934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:39:12.880249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:12.882374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:12.893635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1239/2470] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:39:12.898031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcea38-072d-4335-883b-cda6a300a170 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:12.907312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcea38-072d-4335-883b-cda6a300a170 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:12.911870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:12.913019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:12.913298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:12.913569 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:12.914268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:12.916200 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:12.942086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1232/2471] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:12 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:12.946277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:12.956100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cd156-43d2-49d1-84f0-7ec93a1bc0d7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:13.009347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:13.010001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:13.010282 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:13.010574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:13.011247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:13.013185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:13.031896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1240/2472] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:12 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:13.035961 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:13.046335 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e278c9-5b89-45ed-9460-248aae882e26 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:13.050799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:13.051470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:13.051753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:13.052032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:13.052758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:13.054454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:13.064387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1233/2473] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:13.068263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:13.079118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e6a00-bfaf-405b-9063-49b71052fc73 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:13.083697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907244c8-89b9-4d31-a1d5-45f1c3fe7d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:13.084999 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907244c8-89b9-4d31-a1d5-45f1c3fe7d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:13.085284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907244c8-89b9-4d31-a1d5-45f1c3fe7d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:13.085559 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907244c8-89b9-4d31-a1d5-45f1c3fe7d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:13.086299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907244c8-89b9-4d31-a1d5-45f1c3fe7d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:13.087948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907244c8-89b9-4d31-a1d5-45f1c3fe7d54 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:13.098018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1241/2474] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:13.102023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:13.111678 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecea433-f1b5-44f1-870e-ca9e7b825a83 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:13.116404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:13.117314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:13.117601 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:13.117885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] PATH_INFO: `/v3/projects/72c7c1f2e4f3486493455df0a70f71d5/users/8aa0bb653cfe435e8b76811b76fb1b8d/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:13.132498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c7c1f2e4f3486493455df0a70f71d5, user_id=8aa0bb653cfe435e8b76811b76fb1b8d, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:13.135096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:13.148249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1234/2475] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:13 2022] PUT /identity/v3/projects/72c7c1f2e4f3486493455df0a70f71d5/users/8aa0bb653cfe435e8b76811b76fb1b8d/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:13.158676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:13.158958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:13.159236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:13.184870 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] MFA Rules not processed for user `8aa0bb653cfe435e8b76811b76fb1b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:13.186082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:13.246948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1242/2476] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:13.258237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:13.259979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:13.340051 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f206c-c350-4d20-86eb-f625a399e637 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:13.343673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:13.344307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:13.344587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:13.344861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:13.352824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:13.354234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:13.363031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1235/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:19.143059 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:19.145268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:19.211255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c072ec9-f987-441d-b08c-c3d61378382f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:19.216236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:19.217168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.217581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.217884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] PATH_INFO: `/v3/users/a21a81cf49444a5ab66b6b83e518007a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.219255 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21a81cf49444a5ab66b6b83e518007a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:19.221687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:19.273792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21a81cf49444a5ab66b6b83e518007a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.280821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21a81cf49444a5ab66b6b83e518007a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.288179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21a81cf49444a5ab66b6b83e518007a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.299254 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21a81cf49444a5ab66b6b83e518007a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.299924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562a8d5c-bbf6-4be6-83df-61d9fe22a239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21a81cf49444a5ab66b6b83e518007a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.306520 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1243/2478] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:19 2022] DELETE /identity/v3/users/a21a81cf49444a5ab66b6b83e518007a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:19.485548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:19.499545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8d3f-59dc-46c9-ab97-6c6a83d492f4 service glance] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:19.558059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:19.558920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.559202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.559509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] PATH_INFO: `/v3/projects/65cf5264b1da4554b2269d6ae291ebe5` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.560758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cf5264b1da4554b2269d6ae291ebe5)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:19.562635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:19.608946 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cf5264b1da4554b2269d6ae291ebe5', 'request_id': 'req-73c618c5-541c-432e-b1fa-2024ff72c91e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.615607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cf5264b1da4554b2269d6ae291ebe5', 'request_id': 'req-73c618c5-541c-432e-b1fa-2024ff72c91e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.621803 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cf5264b1da4554b2269d6ae291ebe5', 'request_id': 'req-73c618c5-541c-432e-b1fa-2024ff72c91e'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.637488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] The token cache is being invalidate because project 65cf5264b1da4554b2269d6ae291ebe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:19.637775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.638494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-73c618c5-541c-432e-b1fa-2024ff72c91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:19.640110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1236/2479] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:19 2022] DELETE /identity/v3/projects/65cf5264b1da4554b2269d6ae291ebe5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:19.645950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd046d-b2ca-4179-a52e-f3119b7708cc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.646332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd046d-b2ca-4179-a52e-f3119b7708cc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.647469 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd046d-b2ca-4179-a52e-f3119b7708cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.667651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2bbd046d-b2ca-4179-a52e-f3119b7708cc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:19.669212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2bbd046d-b2ca-4179-a52e-f3119b7708cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:19.733204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1244/2480] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:19.740842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe39e9-c5fa-4372-a734-cb29b3190e2b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.741131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe39e9-c5fa-4372-a734-cb29b3190e2b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.741405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe39e9-c5fa-4372-a734-cb29b3190e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.761671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5cbe39e9-c5fa-4372-a734-cb29b3190e2b None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:19.762861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5cbe39e9-c5fa-4372-a734-cb29b3190e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:19.771276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1237/2481] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:19.775979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd046d-b2ca-4179-a52e-f3119b7708cc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:19.785759 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd046d-b2ca-4179-a52e-f3119b7708cc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:19.790425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:19.791078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.791362 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.791675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.792424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:39:19.792733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:19.794348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:19.806523 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1245/2482] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:39:19.811890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe39e9-c5fa-4372-a734-cb29b3190e2b None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:19.821770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe39e9-c5fa-4372-a734-cb29b3190e2b None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:19.826575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:19.827224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.827573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.827850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.828551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:19.830443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:19.856965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1238/2483] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:19 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:39:19.861202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:19.872148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e2afb-5087-4486-8dee-af22b288ae3b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:19.927349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da06781-995b-421b-8688-92494347b980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:19.928099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da06781-995b-421b-8688-92494347b980 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.928383 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da06781-995b-421b-8688-92494347b980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.928665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da06781-995b-421b-8688-92494347b980 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.929380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da06781-995b-421b-8688-92494347b980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:19.931334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da06781-995b-421b-8688-92494347b980 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:19.954621 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1246/2484] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:19 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:19.955835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:19.966572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2d982-b593-422e-896c-d373f2b2a5bf admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:19.971466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:19.972128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:19.972417 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:19.972698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:19.973444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:19.975114 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:19.985476 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1239/2485] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:19.989479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da06781-995b-421b-8688-92494347b980 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:20.000913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da06781-995b-421b-8688-92494347b980 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:20.006739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf966ff8-049d-471b-a382-eaf6094fb217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:20.007454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf966ff8-049d-471b-a382-eaf6094fb217 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:20.007753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf966ff8-049d-471b-a382-eaf6094fb217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:20.008026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf966ff8-049d-471b-a382-eaf6094fb217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:20.008789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf966ff8-049d-471b-a382-eaf6094fb217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:20.010780 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf966ff8-049d-471b-a382-eaf6094fb217 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:20.023427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1247/2486] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:20.026303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:20.036454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2908d-4ba6-4b52-9f2c-0b2cf084f986 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:20.041196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:20.042067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:20.042350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:20.042628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] PATH_INFO: `/v3/projects/2185d4e79c4947b6869c2dff85759513/users/29fc8e4443914c889245777419348bcf/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:20.057548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2185d4e79c4947b6869c2dff85759513, user_id=29fc8e4443914c889245777419348bcf, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:20.060231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:20.073013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1240/2487] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:20 2022] PUT /identity/v3/projects/2185d4e79c4947b6869c2dff85759513/users/29fc8e4443914c889245777419348bcf/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:20.078112 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510bb51-40f9-4683-bcde-055edd87674e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:20.078400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510bb51-40f9-4683-bcde-055edd87674e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:20.078678 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510bb51-40f9-4683-bcde-055edd87674e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:20.095853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4510bb51-40f9-4683-bcde-055edd87674e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:20.097033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4510bb51-40f9-4683-bcde-055edd87674e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:20.154468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1248/2488] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:20.164314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:20.167179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:20.235750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d611-f29d-4ef1-9d5f-4ec9a4c8bd21 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:20.239375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:20.240047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:20.240852 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:20.241133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:20.250317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:20.251960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:20.262186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1241/2489] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:25.497995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62675561-508e-4835-86bd-fd0cb608eb46 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:25.498508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62675561-508e-4835-86bd-fd0cb608eb46 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:25.498627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62675561-508e-4835-86bd-fd0cb608eb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:25.557497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-62675561-508e-4835-86bd-fd0cb608eb46 None None] MFA Rules not processed for user `29fc8e4443914c889245777419348bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:25.558714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-62675561-508e-4835-86bd-fd0cb608eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:25.641815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1249/2490] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:25.653866 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:25.655317 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:25.758721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758e43e-bb1d-41e7-87b6-1e90364ebc90 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:25.764306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:25.765086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:25.765375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:25.765651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:25.773384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:25.774939 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:25.783694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1242/2491] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:27.584586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47f1ba-ae0d-45be-a9c9-d9bae420e4fe None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:27.585100 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47f1ba-ae0d-45be-a9c9-d9bae420e4fe None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:27.585562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47f1ba-ae0d-45be-a9c9-d9bae420e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:27.604380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ea47f1ba-ae0d-45be-a9c9-d9bae420e4fe None None] MFA Rules not processed for user `29fc8e4443914c889245777419348bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:27.605764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ea47f1ba-ae0d-45be-a9c9-d9bae420e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:27.614289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1250/2492] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:39.348920 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:39.350460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:39.364841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d8f9f-e897-49a7-a486-d6bb4b511dc2 service nova] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:39.369713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:39.370654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:39.371013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:39.371622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] PATH_INFO: `/v3/users/8aa0bb653cfe435e8b76811b76fb1b8d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:39.372725 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa0bb653cfe435e8b76811b76fb1b8d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:39.374974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:39.431383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa0bb653cfe435e8b76811b76fb1b8d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:39.438745 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa0bb653cfe435e8b76811b76fb1b8d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:39.451361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa0bb653cfe435e8b76811b76fb1b8d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:39.457578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa0bb653cfe435e8b76811b76fb1b8d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:39.458771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa0bb653cfe435e8b76811b76fb1b8d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:39.464548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1243/2493] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:39 2022] DELETE /identity/v3/users/8aa0bb653cfe435e8b76811b76fb1b8d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:39.468959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:39.469487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:39.469614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:39.486864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:39.488090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:39.545723 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1251/2494] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:39.556109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:39.557494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:39.620169 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf99ae3-1ea7-455e-9637-53aa16f51349 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:39.623696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904563f0-3ca9-439b-9047-3b3a5d31ebe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:39.624339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904563f0-3ca9-439b-9047-3b3a5d31ebe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:39.624619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904563f0-3ca9-439b-9047-3b3a5d31ebe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:39.624896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904563f0-3ca9-439b-9047-3b3a5d31ebe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:39.633705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904563f0-3ca9-439b-9047-3b3a5d31ebe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:39.635128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904563f0-3ca9-439b-9047-3b3a5d31ebe2 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:39.644353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1244/2495] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:39.904424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:39.905849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:39.924701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec94a-568b-4283-a07f-c377658331ad None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:39.929683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:39.930544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:39.930827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:39.931107 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] PATH_INFO: `/v3/projects/72c7c1f2e4f3486493455df0a70f71d5` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:39.933682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c7c1f2e4f3486493455df0a70f71d5)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:39.935751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:39.981338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c7c1f2e4f3486493455df0a70f71d5', 'request_id': 'req-b7206b5b-8eaa-4080-89de-0e72a4e25e38'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:39.988370 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c7c1f2e4f3486493455df0a70f71d5', 'request_id': 'req-b7206b5b-8eaa-4080-89de-0e72a4e25e38'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:39.994357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c7c1f2e4f3486493455df0a70f71d5', 'request_id': 'req-b7206b5b-8eaa-4080-89de-0e72a4e25e38'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:40.004913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] The token cache is being invalidate because project 72c7c1f2e4f3486493455df0a70f71d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:40.005201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:40.005829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b7206b5b-8eaa-4080-89de-0e72a4e25e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:40.007336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1252/2496] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:39 2022] DELETE /identity/v3/projects/72c7c1f2e4f3486493455df0a70f71d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:40.013477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb18add-0a5e-4270-b336-f9f1bf9343c8 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.013771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb18add-0a5e-4270-b336-f9f1bf9343c8 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.014055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb18add-0a5e-4270-b336-f9f1bf9343c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.031610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2eb18add-0a5e-4270-b336-f9f1bf9343c8 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:40.032793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2eb18add-0a5e-4270-b336-f9f1bf9343c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:40.090517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1245/2497] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:39:40.098104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293549dd-acf2-4845-afcb-eaee9e28580c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.098470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293549dd-acf2-4845-afcb-eaee9e28580c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.099309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293549dd-acf2-4845-afcb-eaee9e28580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.118208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-293549dd-acf2-4845-afcb-eaee9e28580c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:40.119481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-293549dd-acf2-4845-afcb-eaee9e28580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:40.127774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1253/2498] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:40.132070 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb18add-0a5e-4270-b336-f9f1bf9343c8 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:40.141756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb18add-0a5e-4270-b336-f9f1bf9343c8 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:40.146246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:40.146894 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.147174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.147470 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.148202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:39:40.148505 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:40.150101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:40.162064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1246/2499] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:39:40.166569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293549dd-acf2-4845-afcb-eaee9e28580c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:40.175814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293549dd-acf2-4845-afcb-eaee9e28580c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:40.181336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:40.182038 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.182324 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.182594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.183320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:40.185259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:40.211153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1254/2500] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:40 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:40.215255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:40.225497 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2ec37-0857-4653-9059-56e013d3e939 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:40.279300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:40.279982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.280274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.280556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.281249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:40.283153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:40.302691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1247/2501] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:40 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:40.306726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:40.316888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a66c95-66a0-48d2-809d-1a26a4ea4f4e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:40.321653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:40.322335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.322614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.322889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.323661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:40.325277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:40.336672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1255/2502] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:40.340306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:40.350413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbc0cb-8e9c-477e-b3c7-8628b5fe7d59 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:40.354950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd6b46-6b13-4f16-aeaa-b54e59946134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:40.355623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd6b46-6b13-4f16-aeaa-b54e59946134 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.355905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd6b46-6b13-4f16-aeaa-b54e59946134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.356180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd6b46-6b13-4f16-aeaa-b54e59946134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.356914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd6b46-6b13-4f16-aeaa-b54e59946134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:40.358482 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd6b46-6b13-4f16-aeaa-b54e59946134 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:40.367780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1248/2503] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:39:40.371465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:40.381248 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99e0e-42d5-409d-afa0-6d3222aa130e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:40.385896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:40.386837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.387132 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.387435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] PATH_INFO: `/v3/projects/fea89491edc84ef1871715fb491cfd6e/users/7410795876e6442ca2a8a6a7030a1967/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.402277 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea89491edc84ef1871715fb491cfd6e, user_id=7410795876e6442ca2a8a6a7030a1967, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:40.405206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:40.419047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1256/2504] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:40 2022] PUT /identity/v3/projects/fea89491edc84ef1871715fb491cfd6e/users/7410795876e6442ca2a8a6a7030a1967/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:39:40.429985 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.430343 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.430693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.457749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] MFA Rules not processed for user `7410795876e6442ca2a8a6a7030a1967`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:40.459562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:40.528897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1249/2505] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:40.541119 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:40.542796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:40.598576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c53d-e33d-464a-a16b-f82cde365bec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:40.602961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:40.603810 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:40.604105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:40.604404 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:40.612649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:40.614077 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:40.622896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1257/2506] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:49.007191 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.010961 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:49.106891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe0ebb-3ece-421e-bc46-e9a5ec9f6438 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.113418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.114906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.115184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.115484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] PATH_INFO: `/v3/users/ee10df6534284c08973b7d11977def60` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.116698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee10df6534284c08973b7d11977def60)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.118611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.165339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee10df6534284c08973b7d11977def60'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.171873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee10df6534284c08973b7d11977def60'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.183709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee10df6534284c08973b7d11977def60'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.191503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee10df6534284c08973b7d11977def60'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.192253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-54d51842-8eac-4b35-835c-a467263fc56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee10df6534284c08973b7d11977def60'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.198030 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1250/2507] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:39:49 2022] DELETE /identity/v3/users/ee10df6534284c08973b7d11977def60 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:49.372745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.383641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce956d-3ace-4f81-b61f-4c203e536df5 service glance] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.448289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.449680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.450053 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.450858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] PATH_INFO: `/v3/projects/2f5a4bcebbff4cb7940464dc77727b0e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.452529 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5a4bcebbff4cb7940464dc77727b0e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.454594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.500322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5a4bcebbff4cb7940464dc77727b0e', 'request_id': 'req-8ca97021-5013-4b63-8b54-764581e413a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.507599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5a4bcebbff4cb7940464dc77727b0e', 'request_id': 'req-8ca97021-5013-4b63-8b54-764581e413a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.512911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5a4bcebbff4cb7940464dc77727b0e', 'request_id': 'req-8ca97021-5013-4b63-8b54-764581e413a7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.523928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] The token cache is being invalidate because project 2f5a4bcebbff4cb7940464dc77727b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:39:49.524214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.524834 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8ca97021-5013-4b63-8b54-764581e413a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:39:49.526350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1258/2508] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:39:49 2022] DELETE /identity/v3/projects/2f5a4bcebbff4cb7940464dc77727b0e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:49.532614 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3e3a3-cb5a-4b38-bebd-24c7e3c726c6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.532898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3e3a3-cb5a-4b38-bebd-24c7e3c726c6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.533174 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3e3a3-cb5a-4b38-bebd-24c7e3c726c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.551675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-a2d3e3a3-cb5a-4b38-bebd-24c7e3c726c6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:49.552940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a2d3e3a3-cb5a-4b38-bebd-24c7e3c726c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:49.608358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1251/2509] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:49.616489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71305b-62dc-496e-85f4-3f6027f86a52 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.616781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71305b-62dc-496e-85f4-3f6027f86a52 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.617063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71305b-62dc-496e-85f4-3f6027f86a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.635531 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-af71305b-62dc-496e-85f4-3f6027f86a52 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:49.636760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-af71305b-62dc-496e-85f4-3f6027f86a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:49.644916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1259/2510] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:49.650352 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3e3a3-cb5a-4b38-bebd-24c7e3c726c6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.665408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3e3a3-cb5a-4b38-bebd-24c7e3c726c6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.670142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.670805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.671156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.671462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.672201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:39:49.672533 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.674131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.686186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1252/2511] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:39:49.690407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71305b-62dc-496e-85f4-3f6027f86a52 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.700585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71305b-62dc-496e-85f4-3f6027f86a52 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.705452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.706349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.706726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.707009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.708341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.710366 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.735644 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1260/2512] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:49 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:49.740930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.752818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d0318-2d82-410c-81c1-496c7c87ac59 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.808520 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.809192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.809479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.809761 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.810464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.812445 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.831460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1253/2513] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:49 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:39:49.836109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.846455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0b1ec-9e9a-496f-bfe1-03ac0a0f1160 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.851133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.851825 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.852113 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.852394 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.853141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.854752 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.865280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1261/2514] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:49.869328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.883059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9640273-2976-454b-88d8-0e19a2d1aa06 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.889115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274151d-b440-40de-a204-143646d1e9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.889975 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274151d-b440-40de-a204-143646d1e9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.891439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274151d-b440-40de-a204-143646d1e9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.891439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274151d-b440-40de-a204-143646d1e9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.891439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274151d-b440-40de-a204-143646d1e9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.893080 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274151d-b440-40de-a204-143646d1e9eb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.904766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1254/2515] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:49.909084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:49.919145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47410468-431a-4722-8d3e-d869356933b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:49.923963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:49.924839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.925120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.925399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] PATH_INFO: `/v3/projects/202b4de9f7f64b28b4b916cfb595f7f7/users/fc907dd5ef0548ff84bee7c8d7e4ae0f/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.939578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202b4de9f7f64b28b4b916cfb595f7f7, user_id=fc907dd5ef0548ff84bee7c8d7e4ae0f, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:49.942662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:49.955637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1262/2516] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:49 2022] PUT /identity/v3/projects/202b4de9f7f64b28b4b916cfb595f7f7/users/fc907dd5ef0548ff84bee7c8d7e4ae0f/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:49.961409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51b275-db5f-478c-936f-7052b981a461 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:49.961702 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51b275-db5f-478c-936f-7052b981a461 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:49.961982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51b275-db5f-478c-936f-7052b981a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:49.980938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5b51b275-db5f-478c-936f-7052b981a461 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:49.982142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5b51b275-db5f-478c-936f-7052b981a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:50.040705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1255/2517] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:50.050328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:50.052580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:50.112338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008803-4e4a-4d93-bc22-00ee2b9ae4c9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:50.116592 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:50.117245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:50.117525 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:50.117802 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:50.127222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:50.128690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:50.138817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1263/2518] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:39:56.087732 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd9a3-e99c-4b09-a807-a5907bf28b80 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:56.088219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd9a3-e99c-4b09-a807-a5907bf28b80 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:56.088219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd9a3-e99c-4b09-a807-a5907bf28b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:56.119936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e08dd9a3-e99c-4b09-a807-a5907bf28b80 None None] MFA Rules not processed for user `fc907dd5ef0548ff84bee7c8d7e4ae0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:39:56.121274 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e08dd9a3-e99c-4b09-a807-a5907bf28b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:39:56.188781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1256/2519] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:39:56.193291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:56.205210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5947c-d553-4c80-a2b4-8cdd7de43af0 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:56.210547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:56.211208 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:56.211522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:56.211806 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:56.212509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:56.214500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:56.241980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1264/2520] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:39:56 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:56.246016 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dd9a3-e99c-4b09-a807-a5907bf28b80 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:56.257419 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dd9a3-e99c-4b09-a807-a5907bf28b80 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:56.312055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:56.312720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:56.313003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:56.313277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:56.313973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:56.315956 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:56.336171 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1257/2521] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:39:56 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:39:56.340290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:56.350714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfcc5e-13ad-4d28-8c82-f0994a18966b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:56.355466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:56.356135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:56.356422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:56.356707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:56.357503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:56.359099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:56.369669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1265/2522] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:39:56.373870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:56.384799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f58c6f-0550-4d09-af1b-36189563aac3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:56.395363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:56.397941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:56.397941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:56.397941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] PATH_INFO: `/v3/projects/ea8adb862e35410c95f2f0123b60b4da/users/67685d0be5cd4c69bbc14bf183cf27e0/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:56.415384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8adb862e35410c95f2f0123b60b4da, user_id=67685d0be5cd4c69bbc14bf183cf27e0, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:56.418716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:56.436326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1258/2523] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:56 2022] PUT /identity/v3/projects/ea8adb862e35410c95f2f0123b60b4da/users/67685d0be5cd4c69bbc14bf183cf27e0/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:39:56.440620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:56.452968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcda5d-a3be-405d-9893-87a40464cc3e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:56.520281 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2103c87-2e83-4697-80c3-28678aa7d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:56.520611 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2103c87-2e83-4697-80c3-28678aa7d726 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:56.520844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2103c87-2e83-4697-80c3-28678aa7d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:56.521033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2103c87-2e83-4697-80c3-28678aa7d726 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:56.521888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2103c87-2e83-4697-80c3-28678aa7d726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:56.523545 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2103c87-2e83-4697-80c3-28678aa7d726 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:56.541976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1266/2524] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:39:56.547621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:39:56.560864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32904d09-3eda-47b1-b24e-9990df509d03 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:39:56.570926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e74a6-c5a4-47c8-b159-8503006f6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:39:56.571867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e74a6-c5a4-47c8-b159-8503006f6ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:39:56.572152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e74a6-c5a4-47c8-b159-8503006f6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:39:56.572428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e74a6-c5a4-47c8-b159-8503006f6ce7 admin admin] PATH_INFO: `/v3/projects/ea8adb862e35410c95f2f0123b60b4da/users/67685d0be5cd4c69bbc14bf183cf27e0/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:39:56.574529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e74a6-c5a4-47c8-b159-8503006f6ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8adb862e35410c95f2f0123b60b4da, user_id=67685d0be5cd4c69bbc14bf183cf27e0, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:39:56.577075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e74a6-c5a4-47c8-b159-8503006f6ce7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:39:56.592413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1259/2525] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:39:56 2022] PUT /identity/v3/projects/ea8adb862e35410c95f2f0123b60b4da/users/67685d0be5cd4c69bbc14bf183cf27e0/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:40:01.751207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:01.751702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:01.751798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:01.783411 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:01.783860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:01.783860 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:01.794258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] MFA Rules not processed for user `67685d0be5cd4c69bbc14bf183cf27e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:40:01.795764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:01.869714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:40:01.870934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:01.922425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1267/2526] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:40:01.930088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:01.932452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:01.971155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1260/2527] 10.222.0.60 () {58 vars in 967 bytes} [Mon Feb 7 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:40:02.022129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:02.032546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:02.112892 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292b966-06d5-4bb9-b2e7-62253ec32901 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:02.123209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:02.124816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:02.125326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:02.126629 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:02.222969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560c004-09b3-4422-aef6-81fd47175826 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:02.230639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28264196-a7b9-49fb-b513-825fcd482b46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:02.232082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264196-a7b9-49fb-b513-825fcd482b46 service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:02.232535 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264196-a7b9-49fb-b513-825fcd482b46 service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:02.232972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264196-a7b9-49fb-b513-825fcd482b46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:02.248047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28264196-a7b9-49fb-b513-825fcd482b46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:02.249915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28264196-a7b9-49fb-b513-825fcd482b46 service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:02.256348 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:02.258065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:02.270084 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1261/2528] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:40:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:40:02.274353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1268/2529] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:03.872141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6024-6a05-4d28-bbd7-49d526b64d4f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:03.872729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6024-6a05-4d28-bbd7-49d526b64d4f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:03.872729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6024-6a05-4d28-bbd7-49d526b64d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:03.890388 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9a4a6024-6a05-4d28-bbd7-49d526b64d4f None None] MFA Rules not processed for user `fc907dd5ef0548ff84bee7c8d7e4ae0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:40:03.891612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9a4a6024-6a05-4d28-bbd7-49d526b64d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:03.898496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1262/2530] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:40:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:40:10.373008 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:10.374600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:10.438260 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8210d-4ebc-4dbc-aec1-490ca725c9cc service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:10.443481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:10.444343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:10.444628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:10.444904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] PATH_INFO: `/v3/users/363a5d18ceb5439497fe406469397fea` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:10.446092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363a5d18ceb5439497fe406469397fea)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:10.448032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:10.493458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363a5d18ceb5439497fe406469397fea'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.500936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363a5d18ceb5439497fe406469397fea'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.508307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363a5d18ceb5439497fe406469397fea'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.519620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363a5d18ceb5439497fe406469397fea'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.520178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363a5d18ceb5439497fe406469397fea'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.525910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1269/2531] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:40:10 2022] DELETE /identity/v3/users/363a5d18ceb5439497fe406469397fea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:40:10.711877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a6024-6a05-4d28-bbd7-49d526b64d4f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:10.723782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a6024-6a05-4d28-bbd7-49d526b64d4f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:10.793436 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:10.794222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:10.794503 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:10.794781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] PATH_INFO: `/v3/projects/b81ed2187e4b4bb480ac9927221e90fc` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:10.796061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81ed2187e4b4bb480ac9927221e90fc)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:10.798281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:10.846815 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81ed2187e4b4bb480ac9927221e90fc', 'request_id': 'req-7d988b48-449c-4ccb-bc33-4c0b58616422'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.853768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81ed2187e4b4bb480ac9927221e90fc', 'request_id': 'req-7d988b48-449c-4ccb-bc33-4c0b58616422'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.859255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81ed2187e4b4bb480ac9927221e90fc', 'request_id': 'req-7d988b48-449c-4ccb-bc33-4c0b58616422'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.871979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] The token cache is being invalidate because project b81ed2187e4b4bb480ac9927221e90fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:40:10.872267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.872903 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:10.874423 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1263/2532] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:40:10 2022] DELETE /identity/v3/projects/b81ed2187e4b4bb480ac9927221e90fc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:40:10.878414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:10.879836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:10.892582 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971efb1-f90e-4d22-a946-ef07c7c768f1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:10.949753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:10.950620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:10.950897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:10.951168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] PATH_INFO: `/v3/users/47d5b12a78ae4f4c9a3a7367884c603d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:10.952390 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d5b12a78ae4f4c9a3a7367884c603d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:10.954284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:10.998160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d5b12a78ae4f4c9a3a7367884c603d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.005719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d5b12a78ae4f4c9a3a7367884c603d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.010628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:11.012035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:11.013555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d5b12a78ae4f4c9a3a7367884c603d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.025056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b48-449c-4ccb-bc33-4c0b58616422 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:11.026822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d5b12a78ae4f4c9a3a7367884c603d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.027602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-47b91eec-65aa-47c6-86ae-a7a51f5bbc05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d5b12a78ae4f4c9a3a7367884c603d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.030518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:11.031585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:11.031976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:11.032357 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] PATH_INFO: `/v3/users/7410795876e6442ca2a8a6a7030a1967` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:11.033769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7410795876e6442ca2a8a6a7030a1967)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:11.034405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1270/2533] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:40:10 2022] DELETE /identity/v3/users/47d5b12a78ae4f4c9a3a7367884c603d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:40:11.039510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:11.086709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7410795876e6442ca2a8a6a7030a1967'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.093172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7410795876e6442ca2a8a6a7030a1967'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.105290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7410795876e6442ca2a8a6a7030a1967'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.118977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7410795876e6442ca2a8a6a7030a1967'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.119715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7410795876e6442ca2a8a6a7030a1967'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.129737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1264/2534] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:40:11 2022] DELETE /identity/v3/users/7410795876e6442ca2a8a6a7030a1967 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:40:11.131655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:11.132076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:11.132511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:11.152666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:40:11.154220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:11.214069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:11.215880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:11.218961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1271/2535] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:40:11.229258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:11.230492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:11.230611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5b678-433f-415e-8c0b-041818012d5e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:11.235453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:11.236324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:11.236608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:11.236887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] PATH_INFO: `/v3/projects/035234d39a2146c6b5036e9f73197b9b` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:11.238708 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035234d39a2146c6b5036e9f73197b9b)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:11.240670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:11.296144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035234d39a2146c6b5036e9f73197b9b', 'request_id': 'req-c3711f97-b717-499a-977f-731fcd826542'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.302150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bef2c-61d9-4849-b446-80f398c7c3bd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:11.302790 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035234d39a2146c6b5036e9f73197b9b', 'request_id': 'req-c3711f97-b717-499a-977f-731fcd826542'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.309474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035234d39a2146c6b5036e9f73197b9b', 'request_id': 'req-c3711f97-b717-499a-977f-731fcd826542'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.327287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] The token cache is being invalidate because project 035234d39a2146c6b5036e9f73197b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:40:11.327777 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.328508 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.334603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1265/2536] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:40:11 2022] DELETE /identity/v3/projects/035234d39a2146c6b5036e9f73197b9b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:40:11.367449 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:11.368198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:11.368486 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:11.368766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:11.371035 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:11.452862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:11.454333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:11.465849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1272/2537] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 20:40:11.731719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:11.734454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:11.760692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711f97-b717-499a-977f-731fcd826542 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:11.777156 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:11.778324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:11.778611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:11.778890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] PATH_INFO: `/v3/projects/fea89491edc84ef1871715fb491cfd6e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:11.780143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea89491edc84ef1871715fb491cfd6e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:11.782134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:11.832976 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea89491edc84ef1871715fb491cfd6e', 'request_id': 'req-a00bed62-5840-42aa-8ca8-57b680cd4a75'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.839006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea89491edc84ef1871715fb491cfd6e', 'request_id': 'req-a00bed62-5840-42aa-8ca8-57b680cd4a75'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.844491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea89491edc84ef1871715fb491cfd6e', 'request_id': 'req-a00bed62-5840-42aa-8ca8-57b680cd4a75'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.856615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] The token cache is being invalidate because project fea89491edc84ef1871715fb491cfd6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:40:11.856838 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.857457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:40:11.859026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1266/2538] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:40:11 2022] DELETE /identity/v3/projects/fea89491edc84ef1871715fb491cfd6e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:40:20.169798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:20.171202 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:20.225478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28987e6d-90b7-44d7-9659-0067cfd00133 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:20.278492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:20.279147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:20.279455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:20.279735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:20.281515 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:20.352200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:20.353673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:20.365135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1273/2539] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:20.517408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:20.518887 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:20.576055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bed62-5840-42aa-8ca8-57b680cd4a75 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:20.579771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993995-31d9-4167-8aff-adfc91e12806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:20.580414 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993995-31d9-4167-8aff-adfc91e12806 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:20.580697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993995-31d9-4167-8aff-adfc91e12806 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:20.580974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993995-31d9-4167-8aff-adfc91e12806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:20.582953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-a3993995-31d9-4167-8aff-adfc91e12806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:20.596639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993995-31d9-4167-8aff-adfc91e12806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:20.598582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993995-31d9-4167-8aff-adfc91e12806 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:20.610031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1267/2540] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:20.654913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:20.656367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:20.668242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aabb3-d900-47f2-819c-06bdb6f22517 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:20.671844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198319f-3fc2-4fcf-a109-d41c37520a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:20.672482 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198319f-3fc2-4fcf-a109-d41c37520a8e service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:20.672760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198319f-3fc2-4fcf-a109-d41c37520a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:20.673034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198319f-3fc2-4fcf-a109-d41c37520a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:20.674743 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1198319f-3fc2-4fcf-a109-d41c37520a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:20.684275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198319f-3fc2-4fcf-a109-d41c37520a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:20.685684 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198319f-3fc2-4fcf-a109-d41c37520a8e service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:20.694031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1274/2541] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:21.115960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65c74-cd54-4dcb-99af-8742223f2b4a None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:21.116255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65c74-cd54-4dcb-99af-8742223f2b4a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:21.116537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d65c74-cd54-4dcb-99af-8742223f2b4a None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:21.118309 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1268/2542] 10.222.0.60 () {54 vars in 960 bytes} [Mon Feb 7 20:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:40:21.125895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc229a0-2845-4128-bc57-08d9dc7f3aea None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:21.126183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc229a0-2845-4128-bc57-08d9dc7f3aea None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:21.126466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc229a0-2845-4128-bc57-08d9dc7f3aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:21.164359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fcc229a0-2845-4128-bc57-08d9dc7f3aea None None] MFA Rules not processed for user `28c7f1498d7e4ef79977166d285e5e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:40:21.165543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fcc229a0-2845-4128-bc57-08d9dc7f3aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:21.225998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1275/2543] 10.222.0.60 () {58 vars in 1057 bytes} [Mon Feb 7 20:40:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:40:21.233669 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65c74-cd54-4dcb-99af-8742223f2b4a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:21.250456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d65c74-cd54-4dcb-99af-8742223f2b4a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:21.256351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c7f1498d7e4ef79977166d285e5e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:21.256994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:21.257281 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:21.257563 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:21.259334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:21.271555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:21.273145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:21.283105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1269/2544] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:26.775864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2bf7-549e-45ec-932c-5817e8fbff3a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:26.776389 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2bf7-549e-45ec-932c-5817e8fbff3a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:26.776491 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2bf7-549e-45ec-932c-5817e8fbff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:26.794388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-747f2bf7-549e-45ec-932c-5817e8fbff3a None None] MFA Rules not processed for user `97f892d00220472eaca2e132ddba2db8`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:40:26.795617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-747f2bf7-549e-45ec-932c-5817e8fbff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:26.846069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1276/2545] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:40:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:40:26.858165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:26.859620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:26.874743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671bb52-6314-4b68-a8f0-b7b05379d143 service placement] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:26.880260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:26.880899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:26.881184 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:26.881464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:26.883214 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:26.894042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:26.895729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:26.905159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1270/2546] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:27.208865 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f2bf7-549e-45ec-932c-5817e8fbff3a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:27.218303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f2bf7-549e-45ec-932c-5817e8fbff3a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:27.222001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:27.222648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:27.222932 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:27.223209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:27.225009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:27.234583 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:27.236033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:27.243812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1277/2547] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:35.583616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:35.595007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe715836-fa3c-435f-8816-161d5347904d service nova] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:35.600128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:35.601223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:35.601807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:35.602330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:35.610340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:35.621271 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:35.622686 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:35.630642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1271/2548] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:38.125253 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:38.133784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe714fbc-5972-4100-bb0b-7d5cac91782b service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:38.137895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd11363-8203-46a9-a27e-3d0dd982622f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:38.138532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd11363-8203-46a9-a27e-3d0dd982622f service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:38.138818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd11363-8203-46a9-a27e-3d0dd982622f service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:38.139095 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd11363-8203-46a9-a27e-3d0dd982622f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:38.140912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0fd11363-8203-46a9-a27e-3d0dd982622f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:38.201974 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd11363-8203-46a9-a27e-3d0dd982622f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:38.203437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd11363-8203-46a9-a27e-3d0dd982622f service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:38.213163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1278/2549] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:40.634989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:40.648973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127dd02-0cc8-4e05-94d6-b91a45812912 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:40.666879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:40.668299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:40.668691 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:40.669062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:40.675911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:40.689246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:40.691704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:40.703265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1272/2550] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:40:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:40:48.901989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773ea5-a609-41d1-b73c-f845f54a4f91 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:48.902496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773ea5-a609-41d1-b73c-f845f54a4f91 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:48.902852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773ea5-a609-41d1-b73c-f845f54a4f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:48.920745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-62773ea5-a609-41d1-b73c-f845f54a4f91 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:40:48.921946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-62773ea5-a609-41d1-b73c-f845f54a4f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:48.977465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1279/2551] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:40:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:40:48.990824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:40:48.992332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:40:49.058169 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f16b-dd13-45c1-a48d-4dfb4abf310f service nova] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:40:49.063148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d34cc7-f1e5-48f9-8ec5-0c357a2f6792 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:40:49.063830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d34cc7-f1e5-48f9-8ec5-0c357a2f6792 service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:40:49.064112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d34cc7-f1e5-48f9-8ec5-0c357a2f6792 service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:40:49.064386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d34cc7-f1e5-48f9-8ec5-0c357a2f6792 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:40:49.072439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d34cc7-f1e5-48f9-8ec5-0c357a2f6792 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:40:49.074005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d34cc7-f1e5-48f9-8ec5-0c357a2f6792 service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:40:49.081812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1273/2552] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:40:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:41:02.958693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7680-2271-4d11-9e47-95e22c44aa66 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:02.959233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7680-2271-4d11-9e47-95e22c44aa66 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:02.959329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7680-2271-4d11-9e47-95e22c44aa66 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:02.961066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1280/2553] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:41:02.967369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dca35-484a-479b-bf51-22c973f59f76 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:02.967832 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dca35-484a-479b-bf51-22c973f59f76 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:02.968049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dca35-484a-479b-bf51-22c973f59f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:03.006009 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-305dca35-484a-479b-bf51-22c973f59f76 None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:03.007234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-305dca35-484a-479b-bf51-22c973f59f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:03.016746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1274/2554] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:03.028964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc7680-2271-4d11-9e47-95e22c44aa66 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:03.030659 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9ddc7680-2271-4d11-9e47-95e22c44aa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:03.088690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc7680-2271-4d11-9e47-95e22c44aa66 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:03.092368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fac4f-fdc8-4d29-bdb1-271aebbd9d4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:03.093121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fac4f-fdc8-4d29-bdb1-271aebbd9d4d service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:03.093404 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fac4f-fdc8-4d29-bdb1-271aebbd9d4d service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:03.093682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fac4f-fdc8-4d29-bdb1-271aebbd9d4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:03.104226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fac4f-fdc8-4d29-bdb1-271aebbd9d4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:03.105697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fac4f-fdc8-4d29-bdb1-271aebbd9d4d service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:03.116645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1281/2555] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:03.181183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d680-b2cd-48d5-9fc7-88717a9b034e None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:03.181555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d680-b2cd-48d5-9fc7-88717a9b034e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:03.181843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d680-b2cd-48d5-9fc7-88717a9b034e None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:03.183694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1275/2556] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:41:03.188397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:03.188685 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:03.188964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:03.206829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] MFA Rules not processed for user `7b86cad4ee844bdeae28d8a07d8a49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:03.208102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:03.214660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1282/2557] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:41:03.226673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84d680-b2cd-48d5-9fc7-88717a9b034e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:03.237947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84d680-b2cd-48d5-9fc7-88717a9b034e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:03.241473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcab3a-a65e-4a90-82a4-797d99209aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:03.242100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcab3a-a65e-4a90-82a4-797d99209aff service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:03.242386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcab3a-a65e-4a90-82a4-797d99209aff service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:03.242665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcab3a-a65e-4a90-82a4-797d99209aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:03.249538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcab3a-a65e-4a90-82a4-797d99209aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:03.250966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcab3a-a65e-4a90-82a4-797d99209aff service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:03.258574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1276/2558] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:03.472270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:03.473862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:03.493368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca9401-2a24-409d-b26a-066690ba0b1e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:03.499711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:03.499876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:03.500044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:03.500320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:03.502103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:03.517397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:03.519750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:03.535569 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1283/2559] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:05.508775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874050c9-46f8-4d61-83ae-79aaa7675c16 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:05.509233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874050c9-46f8-4d61-83ae-79aaa7675c16 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:05.509370 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874050c9-46f8-4d61-83ae-79aaa7675c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:05.526698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-874050c9-46f8-4d61-83ae-79aaa7675c16 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:05.528124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-874050c9-46f8-4d61-83ae-79aaa7675c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:05.535659 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1277/2560] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:05.556943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:05.568819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fd7e2-fba2-42d1-b2c3-39abc7947e83 service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:05.573788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97c994-7e3b-4326-a9e1-06f55cfb4b3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:05.574448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c994-7e3b-4326-a9e1-06f55cfb4b3a service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:05.574732 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c994-7e3b-4326-a9e1-06f55cfb4b3a service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:05.575006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c994-7e3b-4326-a9e1-06f55cfb4b3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:05.583976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97c994-7e3b-4326-a9e1-06f55cfb4b3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:05.585550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97c994-7e3b-4326-a9e1-06f55cfb4b3a service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:05.593308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1284/2561] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:41:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:41:16.494027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874050c9-46f8-4d61-83ae-79aaa7675c16 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:16.520943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874050c9-46f8-4d61-83ae-79aaa7675c16 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:16.526924 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a3bf-91e5-49f7-b89f-519c527c5217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:16.527867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a3bf-91e5-49f7-b89f-519c527c5217 service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:16.528154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a3bf-91e5-49f7-b89f-519c527c5217 service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:16.528496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a3bf-91e5-49f7-b89f-519c527c5217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:16.530304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c744a3bf-91e5-49f7-b89f-519c527c5217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:16.545758 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a3bf-91e5-49f7-b89f-519c527c5217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:16.547378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a3bf-91e5-49f7-b89f-519c527c5217 service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:16.569747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1278/2562] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:18.042566 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a64ad-c751-401e-8bad-55bb9f118c08 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:18.043115 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a64ad-c751-401e-8bad-55bb9f118c08 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:18.043234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a64ad-c751-401e-8bad-55bb9f118c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:18.061427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-130a64ad-c751-401e-8bad-55bb9f118c08 None None] MFA Rules not processed for user `109bd8f590ec434a9cc0326cbc13890a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:18.062620 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-130a64ad-c751-401e-8bad-55bb9f118c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:18.114534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1285/2563] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:27.248607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972bb3-4b77-4966-9cd2-0a7e54c036e2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:27.249962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972bb3-4b77-4966-9cd2-0a7e54c036e2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:27.250572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972bb3-4b77-4966-9cd2-0a7e54c036e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:27.288395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5c972bb3-4b77-4966-9cd2-0a7e54c036e2 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:27.289863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5c972bb3-4b77-4966-9cd2-0a7e54c036e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:27.300750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1279/2564] 10.222.0.60 () {58 vars in 967 bytes} [Mon Feb 7 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:27.315782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a64ad-c751-401e-8bad-55bb9f118c08 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:27.329478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a64ad-c751-401e-8bad-55bb9f118c08 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:27.335335 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:27.336110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:27.336481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:27.336847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:27.347236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:27.349050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:27.358373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1286/2565] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:41:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:41:31.308518 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972bb3-4b77-4966-9cd2-0a7e54c036e2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:31.318510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972bb3-4b77-4966-9cd2-0a7e54c036e2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:31.322123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:31.322762 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:31.323048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:31.323327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:31.325125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:31.385239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:31.386663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:31.396073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1280/2566] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:34.851832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:34.853612 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:34.880209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a168091-a79f-4eb1-9174-1a817da3acec service swift] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:34.885015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:34.886054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:34.886455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:34.886795 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] PATH_INFO: `/v3/users/97f892d00220472eaca2e132ddba2db8` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:34.888158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f892d00220472eaca2e132ddba2db8)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:34.890184 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:34.945143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f892d00220472eaca2e132ddba2db8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:34.952361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f892d00220472eaca2e132ddba2db8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:34.959877 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f892d00220472eaca2e132ddba2db8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:34.972069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f892d00220472eaca2e132ddba2db8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:34.972781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b477e357-1317-4252-acb2-feea6afd224f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f892d00220472eaca2e132ddba2db8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:34.978550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1287/2567] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:41:34 2022] DELETE /identity/v3/users/97f892d00220472eaca2e132ddba2db8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:35.192158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.207040 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4ab48-849c-4380-94a3-5ba3016949dd service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.265062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.265915 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.266194 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.266469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] PATH_INFO: `/v3/projects/1920726293f94b09a11892df688f137b` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.267690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1920726293f94b09a11892df688f137b)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.269639 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:35.318506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1920726293f94b09a11892df688f137b', 'request_id': 'req-7145f4df-a4ff-4958-b7c6-a72d110196a8'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:35.324412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1920726293f94b09a11892df688f137b', 'request_id': 'req-7145f4df-a4ff-4958-b7c6-a72d110196a8'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:35.329611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1920726293f94b09a11892df688f137b', 'request_id': 'req-7145f4df-a4ff-4958-b7c6-a72d110196a8'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:35.342095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] The token cache is being invalidate because project 1920726293f94b09a11892df688f137b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:41:35.342386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:35.343058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7145f4df-a4ff-4958-b7c6-a72d110196a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:35.344668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1281/2568] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:41:35 2022] DELETE /identity/v3/projects/1920726293f94b09a11892df688f137b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:35.350995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afdd47-1e75-48b5-ab9a-24cf5633ad73 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.351464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afdd47-1e75-48b5-ab9a-24cf5633ad73 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.351751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afdd47-1e75-48b5-ab9a-24cf5633ad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.370481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-55afdd47-1e75-48b5-ab9a-24cf5633ad73 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:35.371735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-55afdd47-1e75-48b5-ab9a-24cf5633ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:35.431445 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1288/2569] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:35.439491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce032911-1ab7-491f-ad30-47f23fbf12e2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.439823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce032911-1ab7-491f-ad30-47f23fbf12e2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.440106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce032911-1ab7-491f-ad30-47f23fbf12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.457938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ce032911-1ab7-491f-ad30-47f23fbf12e2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:35.459143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ce032911-1ab7-491f-ad30-47f23fbf12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:35.467292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1282/2570] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:35.472064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afdd47-1e75-48b5-ab9a-24cf5633ad73 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.481672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afdd47-1e75-48b5-ab9a-24cf5633ad73 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.486320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.487586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.487867 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.488147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.488889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:41:35.489195 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.490821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:35.502123 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1289/2571] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:41:35.506830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce032911-1ab7-491f-ad30-47f23fbf12e2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.516034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce032911-1ab7-491f-ad30-47f23fbf12e2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.520770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.521420 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.521703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.521983 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.522702 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.524637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:35.551113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1283/2572] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:41:35 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:41:35.555175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.565238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74478-dd99-49eb-a225-a58270bdb389 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.620177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.620855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.621140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.621418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.622165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.624120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:35.644446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1290/2573] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:41:35 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:41:35.648549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.659713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7c0d2-093a-4354-9a0c-1feffd859b77 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.664564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.665216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.665496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.665771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.666502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.668129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:35.678257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1284/2574] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:35.682319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.692274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f17d85-c297-4b10-8e1a-652581e6e97d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.696889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510838e-8d8b-4901-b350-e6c44f185393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.697542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510838e-8d8b-4901-b350-e6c44f185393 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.697822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510838e-8d8b-4901-b350-e6c44f185393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.698099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510838e-8d8b-4901-b350-e6c44f185393 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.698840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510838e-8d8b-4901-b350-e6c44f185393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.700456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510838e-8d8b-4901-b350-e6c44f185393 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:35.716374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1291/2575] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:35.717454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.728785 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fe4a1-14c2-4f01-a9da-9ce671f7d843 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.733879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.734880 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.735272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.735602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] PATH_INFO: `/v3/projects/b3675fcf33b547eab94612291f8c649a/users/7ff9f08eb45c4800bb597885eadb5f09/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.750558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3675fcf33b547eab94612291f8c649a, user_id=7ff9f08eb45c4800bb597885eadb5f09, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.754831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:35.782279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1285/2576] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:41:35 2022] PUT /identity/v3/projects/b3675fcf33b547eab94612291f8c649a/users/7ff9f08eb45c4800bb597885eadb5f09/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:35.799129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09970781-d3b9-4a35-8f43-ed763d1917ac None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.799645 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09970781-d3b9-4a35-8f43-ed763d1917ac None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.800079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09970781-d3b9-4a35-8f43-ed763d1917ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.829973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-09970781-d3b9-4a35-8f43-ed763d1917ac None None] MFA Rules not processed for user `7ff9f08eb45c4800bb597885eadb5f09`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:35.831760 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-09970781-d3b9-4a35-8f43-ed763d1917ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:35.909225 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1292/2577] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:41:35.914203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:35.980312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3731eda-f853-486b-ab0e-70d5a07d7178 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:35.987256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:35.987966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:35.988257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:35.988536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:35.989251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:35.991306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.018966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1286/2578] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:41:35 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:41:36.025885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09970781-d3b9-4a35-8f43-ed763d1917ac None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:36.037884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09970781-d3b9-4a35-8f43-ed763d1917ac None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:36.099556 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:36.100359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.100711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.101065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.101859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:36.103911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.129517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1293/2579] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:41:36 2022] POST /identity/v3/users => generated 308 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:41:36.133234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:36.144780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe448d-4372-4652-9f74-0310f22dd0bd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:36.149596 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:36.150265 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.150551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.150835 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.151615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:36.153480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.164966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1287/2580] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:36.169213 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:36.180575 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a6414-03d7-4b50-b171-4091a6800a67 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:36.186709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:36.187318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.187750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.188127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] PATH_INFO: `/v3/projects/b51186820a144783adf94fbafd2c901b/users/a5eb6304108d4df0bc99f40db778500f/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.206234 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51186820a144783adf94fbafd2c901b, user_id=a5eb6304108d4df0bc99f40db778500f, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:36.210122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.232235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1294/2581] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:41:36 2022] PUT /identity/v3/projects/b51186820a144783adf94fbafd2c901b/users/a5eb6304108d4df0bc99f40db778500f/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:36.236262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:36.249069 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7496874-f40f-45c0-b415-8797401cf806 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:36.308701 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c149-ea24-4b45-9d27-1b37b51bfb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:36.309467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c149-ea24-4b45-9d27-1b37b51bfb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.309978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c149-ea24-4b45-9d27-1b37b51bfb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.310474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c149-ea24-4b45-9d27-1b37b51bfb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.311371 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c149-ea24-4b45-9d27-1b37b51bfb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:36.313182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c149-ea24-4b45-9d27-1b37b51bfb94 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.324225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1288/2582] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:36.328494 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:36.339279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba14c0-bcab-432b-9f98-be26d4aaac6a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:36.344073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:36.344993 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.345279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.345560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] PATH_INFO: `/v3/projects/b51186820a144783adf94fbafd2c901b/users/a5eb6304108d4df0bc99f40db778500f/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.347637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51186820a144783adf94fbafd2c901b, user_id=a5eb6304108d4df0bc99f40db778500f, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:36.350250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.360719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1295/2583] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:41:36 2022] PUT /identity/v3/projects/b51186820a144783adf94fbafd2c901b/users/a5eb6304108d4df0bc99f40db778500f/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:36.371949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7b0e-ec43-4ab1-a765-4fcc6b4d0690 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.372240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7b0e-ec43-4ab1-a765-4fcc6b4d0690 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.372699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7b0e-ec43-4ab1-a765-4fcc6b4d0690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.399980 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d6ea7b0e-ec43-4ab1-a765-4fcc6b4d0690 None None] MFA Rules not processed for user `a5eb6304108d4df0bc99f40db778500f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:36.401095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d6ea7b0e-ec43-4ab1-a765-4fcc6b4d0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:36.466564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1289/2584] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:36.475934 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:36.477626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:36.539369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063e38-7bdc-4f4a-a0cf-0b06032a4506 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:36.543205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef7473-d8f8-4056-b682-cc6284c92b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:36.543917 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef7473-d8f8-4056-b682-cc6284c92b75 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.544204 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef7473-d8f8-4056-b682-cc6284c92b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.544511 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef7473-d8f8-4056-b682-cc6284c92b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.554927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef7473-d8f8-4056-b682-cc6284c92b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:36.556405 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef7473-d8f8-4056-b682-cc6284c92b75 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.566706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1296/2585] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:36.797123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea7b0e-ec43-4ab1-a765-4fcc6b4d0690 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:36.861301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea7b0e-ec43-4ab1-a765-4fcc6b4d0690 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:36.866421 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:36.867298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.867822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.868095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] PATH_INFO: `/v3/users/7ff9f08eb45c4800bb597885eadb5f09` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.869390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff9f08eb45c4800bb597885eadb5f09)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:36.871510 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:36.915223 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff9f08eb45c4800bb597885eadb5f09'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:36.921753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff9f08eb45c4800bb597885eadb5f09'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:36.933833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff9f08eb45c4800bb597885eadb5f09'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:36.940647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff9f08eb45c4800bb597885eadb5f09'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:36.941247 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff9f08eb45c4800bb597885eadb5f09'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:36.946965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1290/2586] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:41:36 2022] DELETE /identity/v3/users/7ff9f08eb45c4800bb597885eadb5f09 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:36.953167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:36.953894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:36.954217 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:36.972252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:36.973496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:37.028313 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1297/2587] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:37.038729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:37.040222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:37.096722 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c6ab-5347-4983-b128-49f9f0a90882 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:37.100374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:37.101018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:37.101303 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:37.101582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:37.110425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:37.112500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:37.121718 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1291/2588] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:37.382840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:37.384266 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:37.398470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f51af2-2f93-482b-846e-82cea48c58bb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:37.403346 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:37.404210 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:37.404479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:37.404754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] PATH_INFO: `/v3/projects/b3675fcf33b547eab94612291f8c649a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:37.406004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3675fcf33b547eab94612291f8c649a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:37.407964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:37.452553 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3675fcf33b547eab94612291f8c649a', 'request_id': 'req-9fceb21b-2040-42c1-aa58-b094d6814183'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.459551 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3675fcf33b547eab94612291f8c649a', 'request_id': 'req-9fceb21b-2040-42c1-aa58-b094d6814183'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.464904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3675fcf33b547eab94612291f8c649a', 'request_id': 'req-9fceb21b-2040-42c1-aa58-b094d6814183'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.476029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] The token cache is being invalidate because project b3675fcf33b547eab94612291f8c649a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:41:37.476310 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.476933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.478434 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1298/2589] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:41:37 2022] DELETE /identity/v3/projects/b3675fcf33b547eab94612291f8c649a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:37.482384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:37.491938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2d7d-fff4-447d-aa2c-5195113bef9f service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:37.545293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:37.546148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:37.546429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:37.546705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] PATH_INFO: `/v3/users/a5eb6304108d4df0bc99f40db778500f` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:37.547929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5eb6304108d4df0bc99f40db778500f)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:37.549859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:37.593451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5eb6304108d4df0bc99f40db778500f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.599858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5eb6304108d4df0bc99f40db778500f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.610741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5eb6304108d4df0bc99f40db778500f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.617779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5eb6304108d4df0bc99f40db778500f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.618486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-d2f1f90b-3f94-4524-a18c-3bce50ff8355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5eb6304108d4df0bc99f40db778500f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:37.624204 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1292/2590] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:41:37 2022] DELETE /identity/v3/users/a5eb6304108d4df0bc99f40db778500f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:37.876873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:37.878839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:37.891754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceb21b-2040-42c1-aa58-b094d6814183 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:37.948772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:37.949633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:37.949919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:37.950199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] PATH_INFO: `/v3/projects/b51186820a144783adf94fbafd2c901b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:37.951409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51186820a144783adf94fbafd2c901b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:37.953305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:37.998874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51186820a144783adf94fbafd2c901b', 'request_id': 'req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:38.006526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51186820a144783adf94fbafd2c901b', 'request_id': 'req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:38.011782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51186820a144783adf94fbafd2c901b', 'request_id': 'req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:38.022955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] The token cache is being invalidate because project b51186820a144783adf94fbafd2c901b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:41:38.023235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:38.023888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-fccf8ebd-d527-4ffc-9fa7-4fd84afbc137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:41:38.025413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1299/2591] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:41:37 2022] DELETE /identity/v3/projects/b51186820a144783adf94fbafd2c901b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:41:38.031443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724f27-8295-4c41-90b8-b9f3ed8b6ce4 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.031771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724f27-8295-4c41-90b8-b9f3ed8b6ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.032056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724f27-8295-4c41-90b8-b9f3ed8b6ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.054997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-89724f27-8295-4c41-90b8-b9f3ed8b6ce4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:38.056260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-89724f27-8295-4c41-90b8-b9f3ed8b6ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:38.112334 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1293/2592] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:38.120245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3207-fac9-47b9-9a06-e21b4c48188a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.120537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3207-fac9-47b9-9a06-e21b4c48188a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.120817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3207-fac9-47b9-9a06-e21b4c48188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.140179 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-92ff3207-fac9-47b9-9a06-e21b4c48188a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:38.141354 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-92ff3207-fac9-47b9-9a06-e21b4c48188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:38.150219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1300/2593] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:38.154627 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724f27-8295-4c41-90b8-b9f3ed8b6ce4 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.164154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724f27-8295-4c41-90b8-b9f3ed8b6ce4 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.168660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.169300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.169581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.169858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.170583 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:41:38.170888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.172509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.183879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1294/2594] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:41:38.187975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3207-fac9-47b9-9a06-e21b4c48188a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.197376 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3207-fac9-47b9-9a06-e21b4c48188a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.201951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.202588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.202862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.203130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.203872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.205757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.229911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1301/2595] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:41:38.233955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.244488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136476b-6b26-4874-8501-338562eb6873 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.298203 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.298795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.299716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.299994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.300694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.302594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.321402 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1295/2596] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:41:38.325478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.335489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35051e-2a8c-49e4-855d-dc33f6f0a551 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.340084 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.340794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.341078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.341359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.342093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.343727 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.354436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1302/2597] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:38.358123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.368173 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a37c2-8e26-4a95-ba22-f7268834841b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.372698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c9482-d91d-48ad-b04d-77b3f94dc203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.373331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c9482-d91d-48ad-b04d-77b3f94dc203 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.373616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c9482-d91d-48ad-b04d-77b3f94dc203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.373890 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c9482-d91d-48ad-b04d-77b3f94dc203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.374612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c9482-d91d-48ad-b04d-77b3f94dc203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.376225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c9482-d91d-48ad-b04d-77b3f94dc203 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.385548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1296/2598] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:38.389386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.398977 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922cac7-5769-45c2-9110-d8642006c798 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.403858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.404711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.404995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.405270 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] PATH_INFO: `/v3/projects/eb1fec601b74413a952ce2ce1080b2dd/users/1ee369e5dee5451da853da8865e35b08/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.419733 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1fec601b74413a952ce2ce1080b2dd, user_id=1ee369e5dee5451da853da8865e35b08, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.422334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.435131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1303/2599] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:41:38 2022] PUT /identity/v3/projects/eb1fec601b74413a952ce2ce1080b2dd/users/1ee369e5dee5451da853da8865e35b08/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:38.445468 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785ee05-42dc-4303-b675-b1d4a1da6c56 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.445780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785ee05-42dc-4303-b675-b1d4a1da6c56 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.446058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785ee05-42dc-4303-b675-b1d4a1da6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.471716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2785ee05-42dc-4303-b675-b1d4a1da6c56 None None] MFA Rules not processed for user `1ee369e5dee5451da853da8865e35b08`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:38.472901 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2785ee05-42dc-4303-b675-b1d4a1da6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:38.532294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1297/2600] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:38.537388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.595740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e84fe5-7ec6-4eae-9da1-177a5e465f99 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.600808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.601464 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.601747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.602023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.602737 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.604665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.633056 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1304/2601] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:41:38.637387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785ee05-42dc-4303-b675-b1d4a1da6c56 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.648871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785ee05-42dc-4303-b675-b1d4a1da6c56 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.700728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.701379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.701658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.701932 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.702619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.704545 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.724778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1298/2602] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:41:38.728765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.739106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7135ef-d4f5-4fbe-ae99-c510101f0a28 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.743808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.744461 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.744741 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.745015 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.745750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.747758 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.758489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1305/2603] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:38.762832 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.773242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dd576-127d-4bb2-8037-e9883baaeaf3 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.778222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.779088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.779371 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.779683 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] PATH_INFO: `/v3/projects/6060a51295a64c59bdf4f41209a7b7de/users/b78f9d26808946209ceaee16580bc253/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.794719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6060a51295a64c59bdf4f41209a7b7de, user_id=b78f9d26808946209ceaee16580bc253, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.797432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.809727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1299/2604] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:41:38 2022] PUT /identity/v3/projects/6060a51295a64c59bdf4f41209a7b7de/users/b78f9d26808946209ceaee16580bc253/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:41:38.813614 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.823637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529138-47fb-45a4-8a11-1887f2b0256b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.878409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf3a35-8f0e-4272-8fdc-7caff1eee5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.879081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3a35-8f0e-4272-8fdc-7caff1eee5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.879368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3a35-8f0e-4272-8fdc-7caff1eee5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.879686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf3a35-8f0e-4272-8fdc-7caff1eee5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.880430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf3a35-8f0e-4272-8fdc-7caff1eee5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.882024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf3a35-8f0e-4272-8fdc-7caff1eee5cc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.891502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1306/2605] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:41:38.896101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:38.906313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29400c4-4f93-4e5c-9406-035cd67b5070 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:38.911491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:38.912355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.912632 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.912906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] PATH_INFO: `/v3/projects/6060a51295a64c59bdf4f41209a7b7de/users/b78f9d26808946209ceaee16580bc253/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.914865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6060a51295a64c59bdf4f41209a7b7de, user_id=b78f9d26808946209ceaee16580bc253, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:38.917488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:38.927270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1300/2606] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:41:38 2022] PUT /identity/v3/projects/6060a51295a64c59bdf4f41209a7b7de/users/b78f9d26808946209ceaee16580bc253/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:41:38.938467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:38.938777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:38.939059 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:38.964996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] MFA Rules not processed for user `b78f9d26808946209ceaee16580bc253`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:41:38.966194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:39.034526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1307/2607] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:41:39.043749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:39.045513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:39.100180 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce39e3c-2d73-4668-9e6c-11c86a564a5d admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:39.103836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:39.104474 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:39.104755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:39.105034 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:39.157604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:39.159058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:39.167613 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1301/2608] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:41:44.762388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:41:44.763798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:41:44.775562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65163d87-441a-483a-ba07-d23dda639f79 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:41:44.779345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280b758-dfbe-4e49-a93b-faeea9ce728d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:41:44.780009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b758-dfbe-4e49-a93b-faeea9ce728d service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:41:44.780293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b758-dfbe-4e49-a93b-faeea9ce728d service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:41:44.780571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b758-dfbe-4e49-a93b-faeea9ce728d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:41:44.789580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280b758-dfbe-4e49-a93b-faeea9ce728d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:41:44.791026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280b758-dfbe-4e49-a93b-faeea9ce728d service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:41:44.801001 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1308/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:09.293285 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:09.352953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c03ca-4226-4a72-b766-3789e3a32743 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:09.357424 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:09.358269 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:09.358549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:09.358824 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] PATH_INFO: `/v3/users/1ee369e5dee5451da853da8865e35b08` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:09.360018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee369e5dee5451da853da8865e35b08)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:09.361937 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:09.405300 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee369e5dee5451da853da8865e35b08'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.411783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee369e5dee5451da853da8865e35b08'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.423188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee369e5dee5451da853da8865e35b08'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.430910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee369e5dee5451da853da8865e35b08'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.431573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee369e5dee5451da853da8865e35b08'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.437337 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1302/2610] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:09 2022] DELETE /identity/v3/users/1ee369e5dee5451da853da8865e35b08 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:09.442439 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:09.442933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:09.443029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:09.460165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:09.461350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:09.517866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1309/2611] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:09.527679 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:09.529097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:09.583714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3fedf-f6e3-42af-8483-136495f9a985 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:09.587358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:09.588024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:09.588308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:09.588585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:09.597355 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:09.598813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:09.608113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1303/2612] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:09.865816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:09.869402 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:09.883770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba980882-b53f-47ce-b5aa-b8a825efa773 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:09.898888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:09.899783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:09.900062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:09.901158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] PATH_INFO: `/v3/projects/eb1fec601b74413a952ce2ce1080b2dd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:09.902615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1fec601b74413a952ce2ce1080b2dd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:09.904536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:09.949818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1fec601b74413a952ce2ce1080b2dd', 'request_id': 'req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.956045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1fec601b74413a952ce2ce1080b2dd', 'request_id': 'req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.961391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1fec601b74413a952ce2ce1080b2dd', 'request_id': 'req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.972070 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] The token cache is being invalidate because project eb1fec601b74413a952ce2ce1080b2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:09.972360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.973557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:09.975078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1310/2613] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:09 2022] DELETE /identity/v3/projects/eb1fec601b74413a952ce2ce1080b2dd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:09.979025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:09.989120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f490d-5adf-4a76-8786-196747d27b2a service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.042910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.043736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.044032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.044313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] PATH_INFO: `/v3/users/b78f9d26808946209ceaee16580bc253` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.045509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78f9d26808946209ceaee16580bc253)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.047455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.090447 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78f9d26808946209ceaee16580bc253'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.096991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78f9d26808946209ceaee16580bc253'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.108726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78f9d26808946209ceaee16580bc253'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.115567 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78f9d26808946209ceaee16580bc253'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.116183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-ec6c839c-0f46-4597-be82-ea8848488108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78f9d26808946209ceaee16580bc253'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.121938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1304/2614] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:09 2022] DELETE /identity/v3/users/b78f9d26808946209ceaee16580bc253 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:10.378076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:10.379625 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:10.392355 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ea11-bf5d-4b87-bd48-386c2ec1bdc2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.447549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.448407 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.449626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.449905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] PATH_INFO: `/v3/projects/6060a51295a64c59bdf4f41209a7b7de` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.451098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6060a51295a64c59bdf4f41209a7b7de)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.453042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.497647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6060a51295a64c59bdf4f41209a7b7de', 'request_id': 'req-8630220f-a473-4583-86d5-d540617653dc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.504988 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6060a51295a64c59bdf4f41209a7b7de', 'request_id': 'req-8630220f-a473-4583-86d5-d540617653dc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.510468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6060a51295a64c59bdf4f41209a7b7de', 'request_id': 'req-8630220f-a473-4583-86d5-d540617653dc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.521513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] The token cache is being invalidate because project 6060a51295a64c59bdf4f41209a7b7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:10.521794 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.522414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8630220f-a473-4583-86d5-d540617653dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:10.523980 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1311/2615] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:10 2022] DELETE /identity/v3/projects/6060a51295a64c59bdf4f41209a7b7de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:10.529919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc681-d416-41cc-8b73-77b9cc289413 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.530380 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc681-d416-41cc-8b73-77b9cc289413 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.530479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc681-d416-41cc-8b73-77b9cc289413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.548373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-67efc681-d416-41cc-8b73-77b9cc289413 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:10.549617 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-67efc681-d416-41cc-8b73-77b9cc289413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:10.606290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1305/2616] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:10.613792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbfad-2e27-43f4-8154-3f024ba074c4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.614080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbfad-2e27-43f4-8154-3f024ba074c4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.614360 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddbfad-2e27-43f4-8154-3f024ba074c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.632501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a9ddbfad-2e27-43f4-8154-3f024ba074c4 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:10.633693 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a9ddbfad-2e27-43f4-8154-3f024ba074c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:10.641456 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1312/2617] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:10.646026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc681-d416-41cc-8b73-77b9cc289413 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:10.655941 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc681-d416-41cc-8b73-77b9cc289413 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.660666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.661311 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.661597 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.661878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.662612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:42:10.662923 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.664580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.675919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1306/2618] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:42:10.679962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddbfad-2e27-43f4-8154-3f024ba074c4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:10.688866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddbfad-2e27-43f4-8154-3f024ba074c4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.693975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.694626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.694887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.695156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.695895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.697777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.731334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1313/2619] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:10 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:42:10.735308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:10.744897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dc75c-9ab8-4fb4-b338-902802b5b52f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.800015 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.800693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.800978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.801255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.801967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.803909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.822841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1307/2620] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:10 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:10.826924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:10.837641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4255a-198c-481e-beb1-9d28a74aba90 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.842168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.842816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.843097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.843373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.844139 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.845747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.855278 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1314/2621] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:10.859289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:10.869888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7ff67-387d-484c-814e-2f92f038c928 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.874947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa2cd7-eed5-4668-b0b1-4fbd2b2cda24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.875649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2cd7-eed5-4668-b0b1-4fbd2b2cda24 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.875938 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2cd7-eed5-4668-b0b1-4fbd2b2cda24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.876224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa2cd7-eed5-4668-b0b1-4fbd2b2cda24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.876967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa2cd7-eed5-4668-b0b1-4fbd2b2cda24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.878638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa2cd7-eed5-4668-b0b1-4fbd2b2cda24 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.889046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1308/2622] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:10.893081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:10.902873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076767c0-8dfb-4128-a419-1585c10730d8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:10.907371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:10.908263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.908543 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.908820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] PATH_INFO: `/v3/projects/c9d23058e6f149e18bb9e3a60dd5d76c/users/2654ced7c4434fad90d6c55e60fd5c3f/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.922599 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d23058e6f149e18bb9e3a60dd5d76c, user_id=2654ced7c4434fad90d6c55e60fd5c3f, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:10.925247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:10.938011 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1315/2623] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:10 2022] PUT /identity/v3/projects/c9d23058e6f149e18bb9e3a60dd5d76c/users/2654ced7c4434fad90d6c55e60fd5c3f/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:10.949534 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a710f-34a5-4700-b6ea-733cc358f0ad None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:10.949831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a710f-34a5-4700-b6ea-733cc358f0ad None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:10.950113 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a710f-34a5-4700-b6ea-733cc358f0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:10.975612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d58a710f-34a5-4700-b6ea-733cc358f0ad None None] MFA Rules not processed for user `2654ced7c4434fad90d6c55e60fd5c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:10.976810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d58a710f-34a5-4700-b6ea-733cc358f0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:11.037537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1309/2624] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:11.041914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.099747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e575daf-bc66-4317-bea1-99bf780e5fbc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.104341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.104982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.105264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.105544 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.106232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.108149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.132773 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1316/2625] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:11 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:11.136665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a710f-34a5-4700-b6ea-733cc358f0ad None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.147220 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a710f-34a5-4700-b6ea-733cc358f0ad None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.201060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.201690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.201971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.202246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.202934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.204914 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.227578 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1310/2626] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:11 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:11.231541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.242124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff01a1e-ee1f-4c91-8b68-777b6a7f51c7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.247002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.247701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.247995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.248276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.249029 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.250696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.261005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1317/2627] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:11.264897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.274623 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588e0fa-9ffb-4925-8653-fc33b96a66f7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.279665 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.280529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.280814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.281094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] PATH_INFO: `/v3/projects/670e90c03a4b40d98c3ff001959ce287/users/bcba47014eab4ffb80eb85b1ecfd7e34/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.295833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] RBAC: Authorizing `identity:create_grant(project_id=670e90c03a4b40d98c3ff001959ce287, user_id=bcba47014eab4ffb80eb85b1ecfd7e34, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.298513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.311544 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1311/2628] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:11 2022] PUT /identity/v3/projects/670e90c03a4b40d98c3ff001959ce287/users/bcba47014eab4ffb80eb85b1ecfd7e34/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:11.315432 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.325122 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d064ba3-5422-4178-bc64-64817365614a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.379331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1218f5-c775-4be1-ae78-cab150997cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.380012 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1218f5-c775-4be1-ae78-cab150997cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.380293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1218f5-c775-4be1-ae78-cab150997cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.380571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1218f5-c775-4be1-ae78-cab150997cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.381298 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1218f5-c775-4be1-ae78-cab150997cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.382927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1218f5-c775-4be1-ae78-cab150997cb3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.392269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1318/2629] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:11.396378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.406622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dd46f-f4fa-4036-98ea-bcd10fcd602a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.411784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.412670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.412952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.413228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] PATH_INFO: `/v3/projects/670e90c03a4b40d98c3ff001959ce287/users/bcba47014eab4ffb80eb85b1ecfd7e34/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.415256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] RBAC: Authorizing `identity:create_grant(project_id=670e90c03a4b40d98c3ff001959ce287, user_id=bcba47014eab4ffb80eb85b1ecfd7e34, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.417925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.428624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1312/2630] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:11 2022] PUT /identity/v3/projects/670e90c03a4b40d98c3ff001959ce287/users/bcba47014eab4ffb80eb85b1ecfd7e34/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:11.438534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230f12-ce3b-421d-8d9d-8427e0f4bddc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.438827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230f12-ce3b-421d-8d9d-8427e0f4bddc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.439106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230f12-ce3b-421d-8d9d-8427e0f4bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.464045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d5230f12-ce3b-421d-8d9d-8427e0f4bddc None None] MFA Rules not processed for user `bcba47014eab4ffb80eb85b1ecfd7e34`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:11.465220 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d5230f12-ce3b-421d-8d9d-8427e0f4bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:11.534660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1319/2631] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:11.545359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.547042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:11.603110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca41e30-e767-49ab-b387-0fd7667e694b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.606775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de950cc3-c06b-45e8-83be-21451ddf2bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.607429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de950cc3-c06b-45e8-83be-21451ddf2bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.607721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de950cc3-c06b-45e8-83be-21451ddf2bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.608000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de950cc3-c06b-45e8-83be-21451ddf2bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.616781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de950cc3-c06b-45e8-83be-21451ddf2bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.618215 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de950cc3-c06b-45e8-83be-21451ddf2bf1 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.627454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1313/2632] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:11.688497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230f12-ce3b-421d-8d9d-8427e0f4bddc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.747707 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230f12-ce3b-421d-8d9d-8427e0f4bddc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.752291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.753145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.753430 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.753709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] PATH_INFO: `/v3/users/2654ced7c4434fad90d6c55e60fd5c3f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.754958 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2654ced7c4434fad90d6c55e60fd5c3f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.756906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:11.801047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2654ced7c4434fad90d6c55e60fd5c3f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:11.807630 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2654ced7c4434fad90d6c55e60fd5c3f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:11.814236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2654ced7c4434fad90d6c55e60fd5c3f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:11.825506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2654ced7c4434fad90d6c55e60fd5c3f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:11.826143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2654ced7c4434fad90d6c55e60fd5c3f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:11.831886 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1320/2633] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:11 2022] DELETE /identity/v3/users/2654ced7c4434fad90d6c55e60fd5c3f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:11.836847 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.837131 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.837432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.855225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:11.857193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:11.915716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1314/2634] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:11.925215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:11.926632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:11.981651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729623-74d8-4416-a32c-855d3b1084c5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:11.985351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:11.985988 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:11.986274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:11.986549 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:11.995514 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:11.996945 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:12.007155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1321/2635] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:12.259233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:12.260818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:12.274035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa812bdc-8857-4555-8061-a4ea926e9448 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:12.279146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:12.280064 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:12.280843 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:12.281294 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] PATH_INFO: `/v3/projects/c9d23058e6f149e18bb9e3a60dd5d76c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:12.282571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d23058e6f149e18bb9e3a60dd5d76c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:12.284646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:12.332233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d23058e6f149e18bb9e3a60dd5d76c', 'request_id': 'req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.338308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d23058e6f149e18bb9e3a60dd5d76c', 'request_id': 'req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.343727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d23058e6f149e18bb9e3a60dd5d76c', 'request_id': 'req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.355224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] The token cache is being invalidate because project c9d23058e6f149e18bb9e3a60dd5d76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:12.355540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.356153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.357692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1315/2636] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:12 2022] DELETE /identity/v3/projects/c9d23058e6f149e18bb9e3a60dd5d76c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:12.361757 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:12.371946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e99a08-95b3-40f0-83f4-a210cb5cec15 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:12.429748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:12.430604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:12.430882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:12.431155 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] PATH_INFO: `/v3/users/bcba47014eab4ffb80eb85b1ecfd7e34` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:12.432357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcba47014eab4ffb80eb85b1ecfd7e34)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:12.434357 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:12.609007 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcba47014eab4ffb80eb85b1ecfd7e34'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.616409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcba47014eab4ffb80eb85b1ecfd7e34'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.623247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcba47014eab4ffb80eb85b1ecfd7e34'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.635159 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcba47014eab4ffb80eb85b1ecfd7e34'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.635815 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b2e12140-91a7-4faa-8424-0b8b3fe33ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcba47014eab4ffb80eb85b1ecfd7e34'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:12.641451 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1322/2637] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:12 2022] DELETE /identity/v3/users/bcba47014eab4ffb80eb85b1ecfd7e34 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:12.896237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:12.897697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:12.911870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3726a-1fbf-4520-bf78-cdd22a4d8bc2 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:12.966736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:12.967752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:12.968078 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:12.968339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] PATH_INFO: `/v3/projects/670e90c03a4b40d98c3ff001959ce287` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:12.969516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670e90c03a4b40d98c3ff001959ce287)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:12.971443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.015428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670e90c03a4b40d98c3ff001959ce287', 'request_id': 'req-572cad2d-ae45-45c1-9620-ff7aaaa42341'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:13.021142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670e90c03a4b40d98c3ff001959ce287', 'request_id': 'req-572cad2d-ae45-45c1-9620-ff7aaaa42341'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:13.026457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670e90c03a4b40d98c3ff001959ce287', 'request_id': 'req-572cad2d-ae45-45c1-9620-ff7aaaa42341'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:13.038642 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] The token cache is being invalidate because project 670e90c03a4b40d98c3ff001959ce287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:13.038929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:13.039594 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-572cad2d-ae45-45c1-9620-ff7aaaa42341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:13.041094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1316/2638] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:12 2022] DELETE /identity/v3/projects/670e90c03a4b40d98c3ff001959ce287 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:13.046706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514a38-1bfb-4485-85c9-701dec156bbc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.046996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514a38-1bfb-4485-85c9-701dec156bbc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.047275 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d514a38-1bfb-4485-85c9-701dec156bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.065538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9d514a38-1bfb-4485-85c9-701dec156bbc None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:13.066714 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9d514a38-1bfb-4485-85c9-701dec156bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:13.121938 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1323/2639] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:13.129707 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dc378-9a20-4b00-bd44-7e57f56b97c2 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.130004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dc378-9a20-4b00-bd44-7e57f56b97c2 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.130286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dc378-9a20-4b00-bd44-7e57f56b97c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.148353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-208dc378-9a20-4b00-bd44-7e57f56b97c2 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:13.149524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-208dc378-9a20-4b00-bd44-7e57f56b97c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:13.157446 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1317/2640] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:13.161944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d514a38-1bfb-4485-85c9-701dec156bbc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.171160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d514a38-1bfb-4485-85c9-701dec156bbc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.175782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.176427 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.176708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.176986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.177726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:42:13.178033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.179650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.190640 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1324/2641] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:42:13.194738 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dc378-9a20-4b00-bd44-7e57f56b97c2 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.203886 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dc378-9a20-4b00-bd44-7e57f56b97c2 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.208968 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.209600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.209879 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.210183 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.210994 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.212919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.237560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1318/2642] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:13.241561 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.251214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87f4e-cc67-46af-b415-70dd4e630b4f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.304163 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.304715 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.304995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.305276 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.305969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.307896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.327382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1325/2643] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:13.331496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.341919 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8849a7-2e17-41bb-9d9f-ff62e80e6b5e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.346428 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.347066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.347346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.347661 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.349232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.350846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.360812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1319/2644] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:13.364481 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.374081 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1c753-45a7-4dec-bb84-b8abce013d40 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.378679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a139434-0872-4052-947d-953e9b9d4636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.379317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139434-0872-4052-947d-953e9b9d4636 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.379642 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139434-0872-4052-947d-953e9b9d4636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.379909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a139434-0872-4052-947d-953e9b9d4636 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.380635 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a139434-0872-4052-947d-953e9b9d4636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.382223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a139434-0872-4052-947d-953e9b9d4636 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.391689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1326/2645] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:13.396143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.406036 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a266f-bb71-494e-b10b-205ccf6eb92a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.410604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.412028 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.412312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.412587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] PATH_INFO: `/v3/projects/743533e55d6a4e558469fbe72d9ecb62/users/1cb2a07c2d584f7ebf46062b2f96730e/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.426460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743533e55d6a4e558469fbe72d9ecb62, user_id=1cb2a07c2d584f7ebf46062b2f96730e, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.429124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.441874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1320/2646] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:13 2022] PUT /identity/v3/projects/743533e55d6a4e558469fbe72d9ecb62/users/1cb2a07c2d584f7ebf46062b2f96730e/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:13.453589 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64e50-f158-4bd4-817e-0c78ddd37c5f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.453906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64e50-f158-4bd4-817e-0c78ddd37c5f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.454192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64e50-f158-4bd4-817e-0c78ddd37c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.480633 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-30a64e50-f158-4bd4-817e-0c78ddd37c5f None None] MFA Rules not processed for user `1cb2a07c2d584f7ebf46062b2f96730e`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:13.481826 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-30a64e50-f158-4bd4-817e-0c78ddd37c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:13.543311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1327/2647] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:13.547969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.606680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0730c7f-b8e3-477f-9497-a399ec90de46 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.611242 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.611925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.612205 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.612484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.613193 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.615090 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.639646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1321/2648] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:13.643713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a64e50-f158-4bd4-817e-0c78ddd37c5f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.655003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a64e50-f158-4bd4-817e-0c78ddd37c5f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.707539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.708782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.709069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.709341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.710047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.711997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.730161 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1328/2649] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:13.734176 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.744222 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b950-572c-4330-a41e-7827e129a2f0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.748864 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.749507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.749792 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.750071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.750804 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.752426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.763305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1322/2650] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:13.767265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.777924 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e3297-cbdb-4bf6-8fa1-6cb459c42cb0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.782868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136ed25-2794-475c-869e-8a6c57f56108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.783557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ed25-2794-475c-869e-8a6c57f56108 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.783845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ed25-2794-475c-869e-8a6c57f56108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.784120 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ed25-2794-475c-869e-8a6c57f56108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.784858 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136ed25-2794-475c-869e-8a6c57f56108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.786476 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136ed25-2794-475c-869e-8a6c57f56108 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.796085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1329/2651] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:13.800144 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:13.810350 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec244-cada-487a-8c1a-70816c362ce6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:13.814949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:13.815868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.816254 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.816537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] PATH_INFO: `/v3/projects/821f0d8cc13342a389b80cc9bdd552ca/users/6ac9c01fc38d4ad89ed433ef350b9b64/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.832148 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=821f0d8cc13342a389b80cc9bdd552ca, user_id=6ac9c01fc38d4ad89ed433ef350b9b64, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:13.834830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:13.848458 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1323/2652] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:13 2022] PUT /identity/v3/projects/821f0d8cc13342a389b80cc9bdd552ca/users/6ac9c01fc38d4ad89ed433ef350b9b64/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:13.859518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc237e4-fa15-4d86-8134-fa98fd1a287d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:13.859688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc237e4-fa15-4d86-8134-fa98fd1a287d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:13.859893 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc237e4-fa15-4d86-8134-fa98fd1a287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:13.888875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-edc237e4-fa15-4d86-8134-fa98fd1a287d None None] MFA Rules not processed for user `6ac9c01fc38d4ad89ed433ef350b9b64`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:13.890128 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-edc237e4-fa15-4d86-8134-fa98fd1a287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:13.952590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1330/2653] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:13.957025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.017202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc83e77-512e-41c9-8a19-15588f70d812 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.021829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.022481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.022763 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.023039 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.023787 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.025694 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.052579 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1324/2654] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:13 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:42:14.056506 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc237e4-fa15-4d86-8134-fa98fd1a287d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.066782 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc237e4-fa15-4d86-8134-fa98fd1a287d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.124414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.125653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.125942 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.126227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.126951 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.128913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.151473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1331/2655] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:14 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:14.155198 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.165403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b04d4-e927-4204-9c93-a7ab084cb43f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.170125 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.170776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.171060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.171338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.172115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.173854 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.187489 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1325/2656] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:14.188789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.199250 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b57c9c-d2a9-46d0-a8bd-77bfdb8dd44c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.204071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.204952 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.205238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.205519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] PATH_INFO: `/v3/projects/8e41adc090a54604b0da1045069db03e/users/d4b0584c32f047c08a00437b0108f546/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.219931 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e41adc090a54604b0da1045069db03e, user_id=d4b0584c32f047c08a00437b0108f546, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.222576 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.235411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1332/2657] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:14 2022] PUT /identity/v3/projects/8e41adc090a54604b0da1045069db03e/users/d4b0584c32f047c08a00437b0108f546/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:14.240025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.249935 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ddb3c-b993-411a-8711-603aa733ccf5 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.432814 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfb462-4469-41fd-9f76-95682281f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.433498 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfb462-4469-41fd-9f76-95682281f1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.433778 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfb462-4469-41fd-9f76-95682281f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.434055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfb462-4469-41fd-9f76-95682281f1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.434786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfb462-4469-41fd-9f76-95682281f1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.436403 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfb462-4469-41fd-9f76-95682281f1ed admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.445810 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1326/2658] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:42:14.450104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.460018 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f2313-099b-47d2-9cbc-b3b128dc3e81 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.464470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.465328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.465608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.465883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] PATH_INFO: `/v3/projects/8e41adc090a54604b0da1045069db03e/users/d4b0584c32f047c08a00437b0108f546/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.467839 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e41adc090a54604b0da1045069db03e, user_id=d4b0584c32f047c08a00437b0108f546, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.470435 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.486247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1333/2659] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:14 2022] PUT /identity/v3/projects/8e41adc090a54604b0da1045069db03e/users/d4b0584c32f047c08a00437b0108f546/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:14.498055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7290-d89e-4d5d-8df3-f03bae43eb5e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.498346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7290-d89e-4d5d-8df3-f03bae43eb5e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.498626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7290-d89e-4d5d-8df3-f03bae43eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.523611 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0c3f7290-d89e-4d5d-8df3-f03bae43eb5e None None] MFA Rules not processed for user `d4b0584c32f047c08a00437b0108f546`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:14.524796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0c3f7290-d89e-4d5d-8df3-f03bae43eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:14.591272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1327/2660] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:14.601863 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.603670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:14.664347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01436eb9-5225-473e-a783-2b82363a077f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.668190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.668830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.669110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.669384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.678149 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.679796 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.689025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1334/2661] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:14.726996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f7290-d89e-4d5d-8df3-f03bae43eb5e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:14.736354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f7290-d89e-4d5d-8df3-f03bae43eb5e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:14.739921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b35ef-3b3d-4d61-8a3f-f17133cb4fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:14.740827 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b35ef-3b3d-4d61-8a3f-f17133cb4fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:14.741218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b35ef-3b3d-4d61-8a3f-f17133cb4fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:14.741484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b35ef-3b3d-4d61-8a3f-f17133cb4fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:14.800625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b35ef-3b3d-4d61-8a3f-f17133cb4fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:14.802152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b35ef-3b3d-4d61-8a3f-f17133cb4fa9 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:14.811145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1328/2662] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:17.604374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:17.665041 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f2fdb-2d52-4add-a0f2-38067fc2b808 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:17.669568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:17.670426 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:17.670735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:17.671010 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] PATH_INFO: `/v3/users/1cb2a07c2d584f7ebf46062b2f96730e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:17.672261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb2a07c2d584f7ebf46062b2f96730e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:17.674165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:17.718995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb2a07c2d584f7ebf46062b2f96730e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:17.728843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb2a07c2d584f7ebf46062b2f96730e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:17.737328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb2a07c2d584f7ebf46062b2f96730e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:17.750165 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb2a07c2d584f7ebf46062b2f96730e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:17.753060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb2a07c2d584f7ebf46062b2f96730e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:17.760581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1335/2663] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:17 2022] DELETE /identity/v3/users/1cb2a07c2d584f7ebf46062b2f96730e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:17.765386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:17.765918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:17.766046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:17.804826 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:17.805993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:17.923522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1329/2664] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:17.930969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:17.932832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:17.997744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b253f3f-d1e9-4437-bcc7-bbd17788fe3b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:18.002457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:18.003343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:18.003776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:18.004186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:18.015321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:18.016995 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:18.027663 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1336/2665] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:18.306978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:18.309237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:18.337658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4baee-40c3-4a66-907b-d2ab45f26a79 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:18.346062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:18.347130 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:18.347439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:18.348095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] PATH_INFO: `/v3/projects/743533e55d6a4e558469fbe72d9ecb62` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:18.349692 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] RBAC: Authorizing `identity:delete_project(project_id=743533e55d6a4e558469fbe72d9ecb62)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:18.351654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:18.398438 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743533e55d6a4e558469fbe72d9ecb62', 'request_id': 'req-02417569-f555-4dd1-a03c-dcdb9076886f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.404829 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743533e55d6a4e558469fbe72d9ecb62', 'request_id': 'req-02417569-f555-4dd1-a03c-dcdb9076886f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.410289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743533e55d6a4e558469fbe72d9ecb62', 'request_id': 'req-02417569-f555-4dd1-a03c-dcdb9076886f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.422573 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] The token cache is being invalidate because project 743533e55d6a4e558469fbe72d9ecb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:18.422862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.423515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.425072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1330/2666] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:18 2022] DELETE /identity/v3/projects/743533e55d6a4e558469fbe72d9ecb62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:18.429413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:18.440962 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117ae68-43dc-459e-8d09-973e959596d5 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:18.496050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:18.496923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:18.497222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:18.497490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] PATH_INFO: `/v3/users/6ac9c01fc38d4ad89ed433ef350b9b64` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:18.498694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac9c01fc38d4ad89ed433ef350b9b64)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:18.500637 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:18.547696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac9c01fc38d4ad89ed433ef350b9b64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.554889 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac9c01fc38d4ad89ed433ef350b9b64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.561792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac9c01fc38d4ad89ed433ef350b9b64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.573837 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac9c01fc38d4ad89ed433ef350b9b64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.574521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac9c01fc38d4ad89ed433ef350b9b64'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:18.583331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1337/2667] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:18 2022] DELETE /identity/v3/users/6ac9c01fc38d4ad89ed433ef350b9b64 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:18.858431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:18.860574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:18.887118 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02417569-f555-4dd1-a03c-dcdb9076886f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:18.957666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:18.957666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:18.957666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:18.957666 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] PATH_INFO: `/v3/projects/821f0d8cc13342a389b80cc9bdd552ca` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:18.958936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=821f0d8cc13342a389b80cc9bdd552ca)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:18.960907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.015321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821f0d8cc13342a389b80cc9bdd552ca', 'request_id': 'req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.021793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821f0d8cc13342a389b80cc9bdd552ca', 'request_id': 'req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.027908 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821f0d8cc13342a389b80cc9bdd552ca', 'request_id': 'req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.042321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] The token cache is being invalidate because project 821f0d8cc13342a389b80cc9bdd552ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:19.042716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.043229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.045092 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1331/2668] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:18 2022] DELETE /identity/v3/projects/821f0d8cc13342a389b80cc9bdd552ca => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:19.048876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:19.050812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:19.064787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd4f9-632a-48ea-9d0d-0a4718d6427d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:19.124613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:19.126022 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.126471 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.127014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] PATH_INFO: `/v3/users/d4b0584c32f047c08a00437b0108f546` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.128465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b0584c32f047c08a00437b0108f546)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:19.130811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.177631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b0584c32f047c08a00437b0108f546'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.184503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b0584c32f047c08a00437b0108f546'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.191331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b0584c32f047c08a00437b0108f546'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.202563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b0584c32f047c08a00437b0108f546'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.203219 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1c8486d6-6c78-406e-9eed-c942ef7a36d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b0584c32f047c08a00437b0108f546'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.209003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1338/2669] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:19 2022] DELETE /identity/v3/users/d4b0584c32f047c08a00437b0108f546 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:19.470384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:19.472109 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:19.487187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb6ff5-7bce-4dec-828c-2f669a9f45b1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:19.546163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:19.547019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.547299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.547608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] PATH_INFO: `/v3/projects/8e41adc090a54604b0da1045069db03e` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.548801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e41adc090a54604b0da1045069db03e)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:19.550662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.597210 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e41adc090a54604b0da1045069db03e', 'request_id': 'req-04e47e6a-34e7-4283-a247-558361579601'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.604346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e41adc090a54604b0da1045069db03e', 'request_id': 'req-04e47e6a-34e7-4283-a247-558361579601'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.609828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e41adc090a54604b0da1045069db03e', 'request_id': 'req-04e47e6a-34e7-4283-a247-558361579601'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.622312 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] The token cache is being invalidate because project 8e41adc090a54604b0da1045069db03e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:19.622598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.623219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-04e47e6a-34e7-4283-a247-558361579601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:19.624743 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1332/2670] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:19 2022] DELETE /identity/v3/projects/8e41adc090a54604b0da1045069db03e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:19.633490 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e862-321b-4f62-8351-61134887e6d3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.634500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e862-321b-4f62-8351-61134887e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.634783 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840e862-321b-4f62-8351-61134887e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.653164 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1840e862-321b-4f62-8351-61134887e6d3 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:19.654377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1840e862-321b-4f62-8351-61134887e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:19.711384 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1339/2671] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:42:19.719818 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115646-ce5d-4ea9-a60e-3f4ff0079f53 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.720050 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115646-ce5d-4ea9-a60e-3f4ff0079f53 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.720332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07115646-ce5d-4ea9-a60e-3f4ff0079f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.739143 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-07115646-ce5d-4ea9-a60e-3f4ff0079f53 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:19.740363 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-07115646-ce5d-4ea9-a60e-3f4ff0079f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:19.748155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1333/2672] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:19.752045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e862-321b-4f62-8351-61134887e6d3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:19.761911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840e862-321b-4f62-8351-61134887e6d3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:19.766971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:19.767651 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.767933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.768207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.768964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:42:19.769269 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:19.771453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.782885 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1340/2673] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:42:19.787909 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115646-ce5d-4ea9-a60e-3f4ff0079f53 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:19.796817 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07115646-ce5d-4ea9-a60e-3f4ff0079f53 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:19.801540 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:19.802189 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.802506 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.802786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.803552 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:19.805431 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.830272 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1334/2674] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:19 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:19.834784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:19.844602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e16e46-b6c2-430d-aea2-7cb9da7e31da admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:19.900622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:19.901291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.901580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.902117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.902805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:19.904729 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.923505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1341/2675] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:19 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:19.927662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:19.937558 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0815f2-4026-40c1-8b70-c7ad565286af admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:19.942608 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:19.943246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.943566 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.943842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.944581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:19.946163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.958453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1335/2676] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:19.962462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:19.972289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d3af-ab06-496c-9044-534a5fd6dd95 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:19.977391 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282898a1-fb34-44e9-a5db-3025c1541730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:19.978056 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282898a1-fb34-44e9-a5db-3025c1541730 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:19.978320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282898a1-fb34-44e9-a5db-3025c1541730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:19.978699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282898a1-fb34-44e9-a5db-3025c1541730 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:19.984457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282898a1-fb34-44e9-a5db-3025c1541730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:19.986109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282898a1-fb34-44e9-a5db-3025c1541730 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:19.996361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1342/2677] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:20.000413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.012779 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659cb79-4da0-4159-8854-319fef5a0202 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.017582 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.018454 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.018740 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.019019 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] PATH_INFO: `/v3/projects/7266956926eb4f8d9157b9312a57aa96/users/ee114b1c0aba48fab1acad001c9a284a/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.034749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7266956926eb4f8d9157b9312a57aa96, user_id=ee114b1c0aba48fab1acad001c9a284a, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.037585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.050493 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1336/2678] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:19 2022] PUT /identity/v3/projects/7266956926eb4f8d9157b9312a57aa96/users/ee114b1c0aba48fab1acad001c9a284a/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:20.062201 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea7e58-55c6-4bf8-90ff-0a7eb0f79fcf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.062703 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea7e58-55c6-4bf8-90ff-0a7eb0f79fcf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.062831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea7e58-55c6-4bf8-90ff-0a7eb0f79fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.090284 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-34ea7e58-55c6-4bf8-90ff-0a7eb0f79fcf None None] MFA Rules not processed for user `ee114b1c0aba48fab1acad001c9a284a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:20.091533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-34ea7e58-55c6-4bf8-90ff-0a7eb0f79fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:20.158083 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1343/2679] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:20.162735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.222972 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b206-574c-486c-b8d3-0bdee823e92e admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.227571 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.228230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.228522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.228798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.229599 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.231575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.264658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1337/2680] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:20 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:20.265875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea7e58-55c6-4bf8-90ff-0a7eb0f79fcf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.276631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea7e58-55c6-4bf8-90ff-0a7eb0f79fcf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.339596 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.340296 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.340568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.340905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.341748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.343700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.363600 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1344/2681] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:20 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:20.368061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.378615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03425cd-a207-44da-8f44-8f153b388ada admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.384531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.385270 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.385615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.385963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.386822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.388647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.400211 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1338/2682] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:42:20.405036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.414921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eade0ac-bddf-4ab5-8b73-452a9c04c4ac admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.419606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.420483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.420768 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.421046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] PATH_INFO: `/v3/projects/4617c56ddf20439fbf0eff14b22ff101/users/46368fb25eb24534a779c1d3f539889f/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.436539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4617c56ddf20439fbf0eff14b22ff101, user_id=46368fb25eb24534a779c1d3f539889f, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.439222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.457051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1345/2683] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:20 2022] PUT /identity/v3/projects/4617c56ddf20439fbf0eff14b22ff101/users/46368fb25eb24534a779c1d3f539889f/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:20.461346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.471562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320f660-72fb-41f7-bb4c-1c03eb78bcd7 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.526402 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645b82e-37dd-462e-a681-5c7296d999a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.527318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b82e-37dd-462e-a681-5c7296d999a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.528523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b82e-37dd-462e-a681-5c7296d999a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.528523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645b82e-37dd-462e-a681-5c7296d999a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.529631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b82e-37dd-462e-a681-5c7296d999a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.531640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645b82e-37dd-462e-a681-5c7296d999a2 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.541798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1339/2684] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:20.545560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.556245 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba439c-d64a-4a58-9a16-a460e63ff872 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.560822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.561695 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.561971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.562242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] PATH_INFO: `/v3/projects/4617c56ddf20439fbf0eff14b22ff101/users/46368fb25eb24534a779c1d3f539889f/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.564233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4617c56ddf20439fbf0eff14b22ff101, user_id=46368fb25eb24534a779c1d3f539889f, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.566904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.577361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1346/2685] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:20 2022] PUT /identity/v3/projects/4617c56ddf20439fbf0eff14b22ff101/users/46368fb25eb24534a779c1d3f539889f/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:20.588663 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c382-2a35-4497-84bc-43fc71e7793c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.588979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c382-2a35-4497-84bc-43fc71e7793c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.589256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044c382-2a35-4497-84bc-43fc71e7793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.616293 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0044c382-2a35-4497-84bc-43fc71e7793c None None] MFA Rules not processed for user `46368fb25eb24534a779c1d3f539889f`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:20.617480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0044c382-2a35-4497-84bc-43fc71e7793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:20.685374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1340/2686] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:42:20.695613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.697307 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:20.759963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea76ae1-276c-4151-9a4f-ba3aadb0e528 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.764258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a061f-5c84-4e10-a137-4be6d51ecf4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.764923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a061f-5c84-4e10-a137-4be6d51ecf4d service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.765209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a061f-5c84-4e10-a137-4be6d51ecf4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.765495 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a061f-5c84-4e10-a137-4be6d51ecf4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.774876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a061f-5c84-4e10-a137-4be6d51ecf4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.776400 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a061f-5c84-4e10-a137-4be6d51ecf4d service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.787198 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1347/2687] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:20.856850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c382-2a35-4497-84bc-43fc71e7793c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:20.867618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044c382-2a35-4497-84bc-43fc71e7793c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:20.876511 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:20.877168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:20.877453 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:20.877737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:20.934332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:20.936519 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:20.945153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1341/2688] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:21.177822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f10b2-e861-4ff6-aba8-e55b7addaf27 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:21.178312 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f10b2-e861-4ff6-aba8-e55b7addaf27 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:21.178903 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f10b2-e861-4ff6-aba8-e55b7addaf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:21.191277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:21.197425 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-520f10b2-e861-4ff6-aba8-e55b7addaf27 None None] MFA Rules not processed for user `29fc8e4443914c889245777419348bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:21.198622 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-520f10b2-e861-4ff6-aba8-e55b7addaf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:21.251724 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c800a-8fcf-4226-92b2-697bfdd58328 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:21.252211 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1348/2689] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:21.256251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:21.257159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:21.257441 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:21.257783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] PATH_INFO: `/v3/users/ee114b1c0aba48fab1acad001c9a284a` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:21.258954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee114b1c0aba48fab1acad001c9a284a)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:21.260996 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:21.307277 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee114b1c0aba48fab1acad001c9a284a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:21.313840 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee114b1c0aba48fab1acad001c9a284a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:21.326292 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee114b1c0aba48fab1acad001c9a284a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:21.334770 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee114b1c0aba48fab1acad001c9a284a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:21.335422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee114b1c0aba48fab1acad001c9a284a'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:21.341551 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1342/2690] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:21 2022] DELETE /identity/v3/users/ee114b1c0aba48fab1acad001c9a284a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:21.346173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:21.346533 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:21.346884 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:21.364150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:21.365462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:21.424851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1349/2691] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:21.438145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:21.439607 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:21.495315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b4383-16b9-46be-a50b-a745a8f88fd9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:21.498933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:21.499616 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:21.499904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:21.500185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:21.513977 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:21.515494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:21.526139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1343/2692] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:21.924922 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:21.927303 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:21.947813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae15a5-a067-4843-881f-384fd822e8ea None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:21.960957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:21.961845 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:21.962581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:21.962581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] PATH_INFO: `/v3/projects/7266956926eb4f8d9157b9312a57aa96` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:21.963753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7266956926eb4f8d9157b9312a57aa96)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:21.965954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:22.016688 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7266956926eb4f8d9157b9312a57aa96', 'request_id': 'req-e46a5c35-1386-427e-adbf-ec31b6d1d536'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.033097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7266956926eb4f8d9157b9312a57aa96', 'request_id': 'req-e46a5c35-1386-427e-adbf-ec31b6d1d536'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.039148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7266956926eb4f8d9157b9312a57aa96', 'request_id': 'req-e46a5c35-1386-427e-adbf-ec31b6d1d536'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.050279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] The token cache is being invalidate because project 7266956926eb4f8d9157b9312a57aa96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:22.050507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.051716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.053236 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1350/2693] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:21 2022] DELETE /identity/v3/projects/7266956926eb4f8d9157b9312a57aa96 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:22.057353 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:22.067647 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a0e99-0fb8-46c2-b2a7-d79ba514ecc1 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:22.123631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:22.124491 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.124771 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.125043 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] PATH_INFO: `/v3/users/46368fb25eb24534a779c1d3f539889f` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.126230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46368fb25eb24534a779c1d3f539889f)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:22.128434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:22.175960 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46368fb25eb24534a779c1d3f539889f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.183911 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46368fb25eb24534a779c1d3f539889f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.197100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46368fb25eb24534a779c1d3f539889f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.204052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46368fb25eb24534a779c1d3f539889f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.204782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-122b9b8c-8265-42e8-9386-5222419ed08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46368fb25eb24534a779c1d3f539889f'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.210878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1344/2694] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:22 2022] DELETE /identity/v3/users/46368fb25eb24534a779c1d3f539889f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:22.477996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:22.481088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:22.495318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a5c35-1386-427e-adbf-ec31b6d1d536 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:22.556450 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:22.557233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.557521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.557799 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] PATH_INFO: `/v3/projects/4617c56ddf20439fbf0eff14b22ff101` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.558991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4617c56ddf20439fbf0eff14b22ff101)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:22.560929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:22.604413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4617c56ddf20439fbf0eff14b22ff101', 'request_id': 'req-132886f5-469c-4d5a-ae54-2c53806296e5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.611023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4617c56ddf20439fbf0eff14b22ff101', 'request_id': 'req-132886f5-469c-4d5a-ae54-2c53806296e5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.616862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4617c56ddf20439fbf0eff14b22ff101', 'request_id': 'req-132886f5-469c-4d5a-ae54-2c53806296e5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.627158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] The token cache is being invalidate because project 4617c56ddf20439fbf0eff14b22ff101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:22.627473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.628098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-132886f5-469c-4d5a-ae54-2c53806296e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:22.630274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1351/2695] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:22 2022] DELETE /identity/v3/projects/4617c56ddf20439fbf0eff14b22ff101 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:22.636494 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bac54-10c8-4bf6-bb22-4d769be4734a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.636875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bac54-10c8-4bf6-bb22-4d769be4734a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.637149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bac54-10c8-4bf6-bb22-4d769be4734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.654899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-663bac54-10c8-4bf6-bb22-4d769be4734a None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:22.656110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-663bac54-10c8-4bf6-bb22-4d769be4734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:22.712120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1345/2696] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:22.719910 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1cd30-3538-4330-8ae8-1267d1bc0b63 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.720205 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1cd30-3538-4330-8ae8-1267d1bc0b63 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.720489 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1cd30-3538-4330-8ae8-1267d1bc0b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.739526 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-dfb1cd30-3538-4330-8ae8-1267d1bc0b63 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:22.740713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dfb1cd30-3538-4330-8ae8-1267d1bc0b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:22.748657 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1352/2697] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:22.753340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bac54-10c8-4bf6-bb22-4d769be4734a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:22.764466 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bac54-10c8-4bf6-bb22-4d769be4734a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:22.769808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:22.770473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.770752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.771027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.771796 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:42:22.772105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:22.773700 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:22.785788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1346/2698] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:42:22.790173 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1cd30-3538-4330-8ae8-1267d1bc0b63 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:22.799302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1cd30-3538-4330-8ae8-1267d1bc0b63 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:22.804670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:22.805369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.805690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.805981 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.807291 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:22.810096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:22.838822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1353/2699] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:22 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:22.843049 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:22.853755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1526b-5b19-421e-9591-0cab11ed196a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:22.911376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:22.912133 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.912460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.912735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.913459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:22.915354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:22.937134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1347/2700] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:22 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:22.941221 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:22.953970 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ed27b-065a-457f-8683-cd1fea8794ab admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:22.959971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:22.960652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.960936 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.961214 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:22.962347 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:22.963662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:22.976811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1354/2701] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:42:22.980812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:22.992801 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d7eac-d64c-4d10-b056-7489e598f73b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:22.998096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de35a21-c15b-433d-ab1f-3a5b513afe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:22.998821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35a21-c15b-433d-ab1f-3a5b513afe3a admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:22.999170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35a21-c15b-433d-ab1f-3a5b513afe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:22.999555 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35a21-c15b-433d-ab1f-3a5b513afe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.000367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35a21-c15b-433d-ab1f-3a5b513afe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.002062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35a21-c15b-433d-ab1f-3a5b513afe3a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.012509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1348/2702] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:42:23.016711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.027775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47587-1b90-40c4-85d5-7d7a6937ffb0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.034160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.034160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.034160 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.034508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] PATH_INFO: `/v3/projects/a2cbcab5d7354b21a72c9a4a9b1e5181/users/e6a0aed2d6b449c3ab04669cc13a2871/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.052178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cbcab5d7354b21a72c9a4a9b1e5181, user_id=e6a0aed2d6b449c3ab04669cc13a2871, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.054835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.072200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1355/2703] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:23 2022] PUT /identity/v3/projects/a2cbcab5d7354b21a72c9a4a9b1e5181/users/e6a0aed2d6b449c3ab04669cc13a2871/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:23.082995 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385114ca-daaf-42ad-be35-8af7228869ac None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.083572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385114ca-daaf-42ad-be35-8af7228869ac None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.083572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385114ca-daaf-42ad-be35-8af7228869ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.112969 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-385114ca-daaf-42ad-be35-8af7228869ac None None] MFA Rules not processed for user `e6a0aed2d6b449c3ab04669cc13a2871`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:23.114841 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-385114ca-daaf-42ad-be35-8af7228869ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:23.184587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1349/2704] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:42:23.189042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.249363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b832b-166d-41b0-9fbf-fe4c1572a336 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.254085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.254748 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.255033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.255314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.256066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.257996 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.283192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1356/2705] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:23 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:23.287786 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385114ca-daaf-42ad-be35-8af7228869ac None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.299581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385114ca-daaf-42ad-be35-8af7228869ac None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.356073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.356757 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.357120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.357473 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.358240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.360256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.380528 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1350/2706] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:23 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:23.384777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.395361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba51dd8-8544-4957-b710-6150fa35aa2c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.400080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.400742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.401030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.401314 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.402319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.403994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.415067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1357/2707] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:23.419248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.429670 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e280591-e1a0-4b76-8db3-d6814eef7c35 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.434440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.435318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.435635 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.435918 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] PATH_INFO: `/v3/projects/a7afafe39c12450f9936ba97dff8c8ce/users/409d4f21f610481fb5c2390aedd937e9/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.450344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7afafe39c12450f9936ba97dff8c8ce, user_id=409d4f21f610481fb5c2390aedd937e9, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.453341 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.467325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1351/2708] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:23 2022] PUT /identity/v3/projects/a7afafe39c12450f9936ba97dff8c8ce/users/409d4f21f610481fb5c2390aedd937e9/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:23.471337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.482222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084847c-813f-408d-b8f9-d50a4621b68c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.538424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f89d4-ce65-4a32-b5c0-88453bcc8dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.539105 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f89d4-ce65-4a32-b5c0-88453bcc8dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.539433 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f89d4-ce65-4a32-b5c0-88453bcc8dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.539711 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f89d4-ce65-4a32-b5c0-88453bcc8dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.540492 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f89d4-ce65-4a32-b5c0-88453bcc8dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.542091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f89d4-ce65-4a32-b5c0-88453bcc8dc8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.552285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1358/2709] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:42:23.559310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.572228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508ac3e-eb30-4aa1-9676-80d0642a3d30 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.577554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.578559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.579047 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.579459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] PATH_INFO: `/v3/projects/a7afafe39c12450f9936ba97dff8c8ce/users/409d4f21f610481fb5c2390aedd937e9/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.581882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7afafe39c12450f9936ba97dff8c8ce, user_id=409d4f21f610481fb5c2390aedd937e9, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.585246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.606500 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1352/2710] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:23 2022] PUT /identity/v3/projects/a7afafe39c12450f9936ba97dff8c8ce/users/409d4f21f610481fb5c2390aedd937e9/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:23.608044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3171ba5-c084-4410-bcc7-9a5b7be65bdf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.608333 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3171ba5-c084-4410-bcc7-9a5b7be65bdf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.608613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3171ba5-c084-4410-bcc7-9a5b7be65bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.639247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a3171ba5-c084-4410-bcc7-9a5b7be65bdf None None] MFA Rules not processed for user `409d4f21f610481fb5c2390aedd937e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:23.640655 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a3171ba5-c084-4410-bcc7-9a5b7be65bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:23.716894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1359/2711] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:23.726568 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:23.728298 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:23.785926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117311-a7a7-47a1-b7ad-e8cd1c4f894a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:23.790139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55b58-68ee-4a71-9b5b-98f039fda6c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:23.790799 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55b58-68ee-4a71-9b5b-98f039fda6c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:23.791135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55b58-68ee-4a71-9b5b-98f039fda6c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:23.791362 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55b58-68ee-4a71-9b5b-98f039fda6c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:23.849930 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55b58-68ee-4a71-9b5b-98f039fda6c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:23.851378 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55b58-68ee-4a71-9b5b-98f039fda6c8 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:23.861605 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1353/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:26.393992 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3171ba5-c084-4410-bcc7-9a5b7be65bdf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:26.453417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3171ba5-c084-4410-bcc7-9a5b7be65bdf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:26.459325 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:26.460239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:26.460522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:26.460805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] PATH_INFO: `/v3/users/e6a0aed2d6b449c3ab04669cc13a2871` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:26.462080 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a0aed2d6b449c3ab04669cc13a2871)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:26.464046 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:26.513047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a0aed2d6b449c3ab04669cc13a2871'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:26.521180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a0aed2d6b449c3ab04669cc13a2871'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:26.532180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a0aed2d6b449c3ab04669cc13a2871'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:26.545140 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a0aed2d6b449c3ab04669cc13a2871'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:26.545957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a0aed2d6b449c3ab04669cc13a2871'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:26.552097 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1360/2713] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:26 2022] DELETE /identity/v3/users/e6a0aed2d6b449c3ab04669cc13a2871 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:26.556933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:26.557487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:26.557782 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:26.578368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:26.579621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:26.640800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1354/2714] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:26.650679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:26.652350 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:26.707897 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0b10-d1f7-4fe7-8fa5-e970e5bad323 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:26.711658 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:26.712321 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:26.712607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:26.712883 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:26.721852 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:26.723875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:26.733363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1361/2715] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:27.082751 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:27.086882 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:27.099603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb89b68-63ad-416a-97b2-24fdeb11ef77 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:27.104488 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:27.105329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:27.105606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:27.105878 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] PATH_INFO: `/v3/projects/a2cbcab5d7354b21a72c9a4a9b1e5181` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:27.107048 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2cbcab5d7354b21a72c9a4a9b1e5181)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:27.109480 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:27.153328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2cbcab5d7354b21a72c9a4a9b1e5181', 'request_id': 'req-8f1f0a47-2707-400e-a1c5-855650770684'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.159338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2cbcab5d7354b21a72c9a4a9b1e5181', 'request_id': 'req-8f1f0a47-2707-400e-a1c5-855650770684'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.165433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2cbcab5d7354b21a72c9a4a9b1e5181', 'request_id': 'req-8f1f0a47-2707-400e-a1c5-855650770684'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.178071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] The token cache is being invalidate because project a2cbcab5d7354b21a72c9a4a9b1e5181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:27.178455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.179150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.180766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1355/2716] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:27 2022] DELETE /identity/v3/projects/a2cbcab5d7354b21a72c9a4a9b1e5181 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:27.184766 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:27.194462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e7b6-bede-45e9-8fcb-2e7d49b2a69a service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:27.247216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:27.248118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:27.248379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:27.248650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] PATH_INFO: `/v3/users/409d4f21f610481fb5c2390aedd937e9` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:27.249853 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=409d4f21f610481fb5c2390aedd937e9)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:27.251785 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:27.294692 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409d4f21f610481fb5c2390aedd937e9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.300959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409d4f21f610481fb5c2390aedd937e9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.307631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409d4f21f610481fb5c2390aedd937e9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.319283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409d4f21f610481fb5c2390aedd937e9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.319957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2dac1073-d965-4343-8c5c-6e971429e92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409d4f21f610481fb5c2390aedd937e9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.325869 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1362/2717] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:27 2022] DELETE /identity/v3/users/409d4f21f610481fb5c2390aedd937e9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:27.824168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:27.826046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:27.838916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0a47-2707-400e-a1c5-855650770684 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:27.896330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:27.897225 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:27.897513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:27.897795 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] PATH_INFO: `/v3/projects/a7afafe39c12450f9936ba97dff8c8ce` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:27.899168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7afafe39c12450f9936ba97dff8c8ce)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:27.901375 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:27.950502 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7afafe39c12450f9936ba97dff8c8ce', 'request_id': 'req-4e967173-8bd1-400c-b69f-af5234a29566'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.956649 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7afafe39c12450f9936ba97dff8c8ce', 'request_id': 'req-4e967173-8bd1-400c-b69f-af5234a29566'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.962942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7afafe39c12450f9936ba97dff8c8ce', 'request_id': 'req-4e967173-8bd1-400c-b69f-af5234a29566'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.976100 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] The token cache is being invalidate because project a7afafe39c12450f9936ba97dff8c8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:27.976390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.977012 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4e967173-8bd1-400c-b69f-af5234a29566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:27.978531 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1356/2718] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:27 2022] DELETE /identity/v3/projects/a7afafe39c12450f9936ba97dff8c8ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:42:27.984443 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302222db-7599-4969-a974-9ce111994c6f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:27.984953 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302222db-7599-4969-a974-9ce111994c6f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:27.985228 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302222db-7599-4969-a974-9ce111994c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.006708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-302222db-7599-4969-a974-9ce111994c6f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:28.008075 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-302222db-7599-4969-a974-9ce111994c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:28.064499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1363/2719] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:28.072715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d07fe-70cf-4501-8ecc-0d45c3627aaa None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.073002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d07fe-70cf-4501-8ecc-0d45c3627aaa None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.073279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d07fe-70cf-4501-8ecc-0d45c3627aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.092139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-e36d07fe-70cf-4501-8ecc-0d45c3627aaa None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:28.093315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e36d07fe-70cf-4501-8ecc-0d45c3627aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:28.101228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1357/2720] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:28.105446 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302222db-7599-4969-a974-9ce111994c6f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.115013 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302222db-7599-4969-a974-9ce111994c6f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.119699 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.120351 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.120628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.120899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.121665 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:42:28.121968 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.123586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.135337 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1364/2721] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:42:28.139728 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d07fe-70cf-4501-8ecc-0d45c3627aaa None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.149278 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d07fe-70cf-4501-8ecc-0d45c3627aaa None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.154110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.154755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.155038 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.155314 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.156053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.157934 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.185991 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1358/2722] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:28.190356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.201698 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81db55-a8e9-4047-a86a-7696ca17669c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.265836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.266579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.266944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.267283 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.268190 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.270679 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.291851 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1365/2723] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:28.295949 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.306209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13c334-435b-45be-b55c-40c1bab2f8b4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.311126 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.311855 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.312142 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.312422 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.313218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.314822 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.325667 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1359/2724] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:42:28.329555 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.340318 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce97a6-0ee9-4ac4-8a0c-31de678d1493 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.344905 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef037c8c-3f95-4c62-a67b-d956979b1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.345552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef037c8c-3f95-4c62-a67b-d956979b1447 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.345836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef037c8c-3f95-4c62-a67b-d956979b1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.346129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef037c8c-3f95-4c62-a67b-d956979b1447 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.346849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef037c8c-3f95-4c62-a67b-d956979b1447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.349092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef037c8c-3f95-4c62-a67b-d956979b1447 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.358801 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1366/2725] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:28.362744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.372301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0e774-19ee-42f6-bf0a-67fa5d11e7c1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.376842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.377697 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.377980 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.378259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] PATH_INFO: `/v3/projects/e1c7ae1dfec3448f8feaa0ede5a6a7b6/users/b7f3eb139a15418a9d011c5cfde249a6/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.392685 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c7ae1dfec3448f8feaa0ede5a6a7b6, user_id=b7f3eb139a15418a9d011c5cfde249a6, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.396011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.409620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1360/2726] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:28 2022] PUT /identity/v3/projects/e1c7ae1dfec3448f8feaa0ede5a6a7b6/users/b7f3eb139a15418a9d011c5cfde249a6/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:28.420740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afbd9e-fb73-4d3e-9296-7100dcd08ba2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.421032 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afbd9e-fb73-4d3e-9296-7100dcd08ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.421315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afbd9e-fb73-4d3e-9296-7100dcd08ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.447332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-30afbd9e-fb73-4d3e-9296-7100dcd08ba2 None None] MFA Rules not processed for user `b7f3eb139a15418a9d011c5cfde249a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:28.448503 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-30afbd9e-fb73-4d3e-9296-7100dcd08ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:28.509812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1367/2727] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:28.514237 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.572705 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744ca8-36b5-4669-9044-310f06fee8db admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.577304 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.577952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.578230 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.578504 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.579239 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.581487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.607024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1361/2728] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:28.611156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afbd9e-fb73-4d3e-9296-7100dcd08ba2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.621964 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afbd9e-fb73-4d3e-9296-7100dcd08ba2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.674143 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.674807 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.675085 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.675359 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.676660 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.678539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.698055 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1368/2729] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:28.701892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.711715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b6b8-50d9-44e3-bf51-36a6b825de73 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.716235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.716872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.717152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.717427 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.718153 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.719776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.729747 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1362/2730] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:28.733480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.743604 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b0d38-e87d-4023-b81f-494051e77fca admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.749069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6a212-11a9-404b-bcaa-0bc1e4215463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.749594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a212-11a9-404b-bcaa-0bc1e4215463 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.751532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a212-11a9-404b-bcaa-0bc1e4215463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.751532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a212-11a9-404b-bcaa-0bc1e4215463 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.751532 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6a212-11a9-404b-bcaa-0bc1e4215463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.753192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6a212-11a9-404b-bcaa-0bc1e4215463 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.764235 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1369/2731] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:28.768458 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.778572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a26d-23a9-41c5-a85c-3c5a48b4c134 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.783127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.784023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.784308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.784587 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] PATH_INFO: `/v3/projects/8d8df001aa164957be59e70b5322f347/users/452c57451ea94c81b59a3268e31ba41d/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.798464 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8df001aa164957be59e70b5322f347, user_id=452c57451ea94c81b59a3268e31ba41d, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.801629 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:28.813684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1363/2732] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:28 2022] PUT /identity/v3/projects/8d8df001aa164957be59e70b5322f347/users/452c57451ea94c81b59a3268e31ba41d/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:28.824534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fd624-91b1-4031-ab14-fad8386dcf27 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.824830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fd624-91b1-4031-ab14-fad8386dcf27 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.825116 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fd624-91b1-4031-ab14-fad8386dcf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.851168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-425fd624-91b1-4031-ab14-fad8386dcf27 None None] MFA Rules not processed for user `452c57451ea94c81b59a3268e31ba41d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:28.852424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-425fd624-91b1-4031-ab14-fad8386dcf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:28.918560 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1370/2733] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:28.923188 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:28.981550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1f387-e31e-4d26-a384-597556e1876f admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:28.986061 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:28.986699 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:28.986981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:28.987256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:28.987989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:28.990562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:29.014101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1364/2734] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:42:28 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:42:29.018135 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fd624-91b1-4031-ab14-fad8386dcf27 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:29.028735 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fd624-91b1-4031-ab14-fad8386dcf27 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:29.086517 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:29.087232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:29.087547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:29.087830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:29.088568 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:29.090836 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:29.110527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1371/2735] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:42:29 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:42:29.115065 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:29.124971 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca80fb-3128-4858-a0f0-e596c47adc14 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:29.129556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:29.130201 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:29.130487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:29.130767 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:29.131532 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:29.133157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:29.143152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1365/2736] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:42:29.147194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:29.157249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c054da-8def-49b4-8583-a56f124a96c0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:29.162308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:29.163166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:29.163479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:29.163762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] PATH_INFO: `/v3/projects/4b349dc4cb734002ae6667e9c4c720a9/users/5ef136562ed048ea9bbf02ea3a713cae/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:29.178442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b349dc4cb734002ae6667e9c4c720a9, user_id=5ef136562ed048ea9bbf02ea3a713cae, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:29.181098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:29.193185 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1372/2737] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:29 2022] PUT /identity/v3/projects/4b349dc4cb734002ae6667e9c4c720a9/users/5ef136562ed048ea9bbf02ea3a713cae/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:29.197032 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:29.206831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1a00-7979-4a6e-9d59-d17eb0467ae6 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:29.261241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3cb2e-355b-4c2f-9591-e1724dad47ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:29.261836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3cb2e-355b-4c2f-9591-e1724dad47ac admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:29.262161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3cb2e-355b-4c2f-9591-e1724dad47ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:29.262399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3cb2e-355b-4c2f-9591-e1724dad47ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:29.263134 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3cb2e-355b-4c2f-9591-e1724dad47ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:29.264789 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3cb2e-355b-4c2f-9591-e1724dad47ac admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:29.274929 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1366/2738] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 20:42:29.279369 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:29.289963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ef630-197d-4c1f-966b-34e22ee94291 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:29.294615 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:29.295519 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:29.295805 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:29.296079 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] PATH_INFO: `/v3/projects/4b349dc4cb734002ae6667e9c4c720a9/users/5ef136562ed048ea9bbf02ea3a713cae/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:29.298063 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b349dc4cb734002ae6667e9c4c720a9, user_id=5ef136562ed048ea9bbf02ea3a713cae, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:29.300800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:29.311241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1373/2739] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:42:29 2022] PUT /identity/v3/projects/4b349dc4cb734002ae6667e9c4c720a9/users/5ef136562ed048ea9bbf02ea3a713cae/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:29.321425 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:29.321714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:29.321989 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:29.348467 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] MFA Rules not processed for user `5ef136562ed048ea9bbf02ea3a713cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:29.349681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:29.416742 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1367/2740] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:29.427232 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:29.428949 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:29.483327 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85c01-dc8f-4ce5-b9c1-f9673d70b2f7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:29.486957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:29.487623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:29.487906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:29.488186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:29.541866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:29.543233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:29.551933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1374/2741] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:30.998562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:31.000054 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:31.011834 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e50ef-914d-4862-a54a-c8d16a61f09f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:31.015603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:31.016241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:31.016523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:31.016821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:31.072327 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:31.073768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:31.083377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1368/2742] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:31.587216 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:31.595554 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb9259-5041-449d-8b32-52c12c0ab068 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:31.599157 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204505ff-e293-4a36-b558-a52a7afed7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:31.599827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204505ff-e293-4a36-b558-a52a7afed7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:31.600114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204505ff-e293-4a36-b558-a52a7afed7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:31.600397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204505ff-e293-4a36-b558-a52a7afed7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:31.609509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204505ff-e293-4a36-b558-a52a7afed7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:31.610874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204505ff-e293-4a36-b558-a52a7afed7b8 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:31.621166 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1375/2743] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:35.532713 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:35.592117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec59e62-a3b5-4a15-9c7b-1bd8db18ebb5 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:35.596549 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:35.597405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:35.597684 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:35.597962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] PATH_INFO: `/v3/users/b7f3eb139a15418a9d011c5cfde249a6` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:35.599127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f3eb139a15418a9d011c5cfde249a6)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:35.601135 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:35.645517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f3eb139a15418a9d011c5cfde249a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:35.652490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f3eb139a15418a9d011c5cfde249a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:35.663755 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f3eb139a15418a9d011c5cfde249a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:35.670819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f3eb139a15418a9d011c5cfde249a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:35.671496 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f3eb139a15418a9d011c5cfde249a6'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:35.677025 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1369/2744] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:35 2022] DELETE /identity/v3/users/b7f3eb139a15418a9d011c5cfde249a6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:35.681624 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:35.682112 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:35.682243 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:35.699966 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:35.701305 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:35.761608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1376/2745] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:35.772542 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:35.773917 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:35.828961 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb755c-11b6-4397-bf0d-b2647f8293ca admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:35.832621 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:35.833749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:35.834052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:35.834329 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:35.843096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:35.844560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:35.854111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1370/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:42:36.102483 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:36.103989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:36.116594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afabefb-4748-421b-85dc-190df1f77467 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:36.121203 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:36.122049 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:36.122329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:36.123239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] PATH_INFO: `/v3/projects/e1c7ae1dfec3448f8feaa0ede5a6a7b6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:36.124902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c7ae1dfec3448f8feaa0ede5a6a7b6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:36.126907 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:36.171468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c7ae1dfec3448f8feaa0ede5a6a7b6', 'request_id': 'req-29f62964-0796-4492-b8e8-576d5d210e86'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.179552 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c7ae1dfec3448f8feaa0ede5a6a7b6', 'request_id': 'req-29f62964-0796-4492-b8e8-576d5d210e86'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.184754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c7ae1dfec3448f8feaa0ede5a6a7b6', 'request_id': 'req-29f62964-0796-4492-b8e8-576d5d210e86'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.195908 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] The token cache is being invalidate because project e1c7ae1dfec3448f8feaa0ede5a6a7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:36.196194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.196822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.198386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1377/2747] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:36 2022] DELETE /identity/v3/projects/e1c7ae1dfec3448f8feaa0ede5a6a7b6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:36.202581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:36.212083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae478e1e-5873-4567-965e-8a69fa01bd02 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:36.265530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:36.266390 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:36.266668 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:36.266944 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] PATH_INFO: `/v3/users/452c57451ea94c81b59a3268e31ba41d` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:36.268146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452c57451ea94c81b59a3268e31ba41d)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:36.270096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:36.313332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452c57451ea94c81b59a3268e31ba41d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.320501 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452c57451ea94c81b59a3268e31ba41d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.331538 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452c57451ea94c81b59a3268e31ba41d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.338164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452c57451ea94c81b59a3268e31ba41d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.338813 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452c57451ea94c81b59a3268e31ba41d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.344479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1371/2748] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:36 2022] DELETE /identity/v3/users/452c57451ea94c81b59a3268e31ba41d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:36.602832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:36.604287 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:36.617734 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f62964-0796-4492-b8e8-576d5d210e86 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:36.672820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:36.673676 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:36.673959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:36.674240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] PATH_INFO: `/v3/projects/8d8df001aa164957be59e70b5322f347` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:36.676109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8df001aa164957be59e70b5322f347)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:36.679340 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:36.726285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8df001aa164957be59e70b5322f347', 'request_id': 'req-4cac0e5d-e534-4700-bdae-897f76267235'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.732690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8df001aa164957be59e70b5322f347', 'request_id': 'req-4cac0e5d-e534-4700-bdae-897f76267235'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.738051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8df001aa164957be59e70b5322f347', 'request_id': 'req-4cac0e5d-e534-4700-bdae-897f76267235'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.748588 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] The token cache is being invalidate because project 8d8df001aa164957be59e70b5322f347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:36.748900 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.749528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.751027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1378/2749] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:36 2022] DELETE /identity/v3/projects/8d8df001aa164957be59e70b5322f347 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:36.755017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:36.756478 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:36.772456 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65550bcd-5e58-4d15-939b-9acd1801d808 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:36.827030 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:36.827862 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:36.828149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:36.828432 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] PATH_INFO: `/v3/users/5ef136562ed048ea9bbf02ea3a713cae` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:36.829660 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef136562ed048ea9bbf02ea3a713cae)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:36.831606 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:36.876232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef136562ed048ea9bbf02ea3a713cae'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.882910 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef136562ed048ea9bbf02ea3a713cae'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.894940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef136562ed048ea9bbf02ea3a713cae'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.902828 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef136562ed048ea9bbf02ea3a713cae'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.903477 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-36ba974e-5383-401f-b4c1-95a6181987fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef136562ed048ea9bbf02ea3a713cae'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:36.909245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1372/2750] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:42:36 2022] DELETE /identity/v3/users/5ef136562ed048ea9bbf02ea3a713cae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:37.171990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:37.173444 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:37.186606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac0e5d-e534-4700-bdae-897f76267235 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:37.241677 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:37.242522 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:37.242800 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:37.243078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] PATH_INFO: `/v3/projects/4b349dc4cb734002ae6667e9c4c720a9` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:37.244280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b349dc4cb734002ae6667e9c4c720a9)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:37.246156 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:37.290261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b349dc4cb734002ae6667e9c4c720a9', 'request_id': 'req-00a4353b-b895-41a4-8cd7-b339d5477cc3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:37.296990 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b349dc4cb734002ae6667e9c4c720a9', 'request_id': 'req-00a4353b-b895-41a4-8cd7-b339d5477cc3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:37.302288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b349dc4cb734002ae6667e9c4c720a9', 'request_id': 'req-00a4353b-b895-41a4-8cd7-b339d5477cc3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:37.312697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] The token cache is being invalidate because project 4b349dc4cb734002ae6667e9c4c720a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:42:37.312985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:37.313609 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-00a4353b-b895-41a4-8cd7-b339d5477cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:42:37.315138 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1379/2751] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:42:37 2022] DELETE /identity/v3/projects/4b349dc4cb734002ae6667e9c4c720a9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:42:53.388132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff399282-1171-4e83-89de-7bc5d1f4d48f None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:53.388746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff399282-1171-4e83-89de-7bc5d1f4d48f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:53.388746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff399282-1171-4e83-89de-7bc5d1f4d48f None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:53.390516 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1373/2752] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:42:53.396463 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:53.396960 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:53.397066 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:53.416367 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] MFA Rules not processed for user `7b86cad4ee844bdeae28d8a07d8a49b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:42:53.417672 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:53.468398 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1380/2753] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:42:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:42:53.480434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff399282-1171-4e83-89de-7bc5d1f4d48f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:42:53.482157 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ff399282-1171-4e83-89de-7bc5d1f4d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:42:53.495850 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff399282-1171-4e83-89de-7bc5d1f4d48f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:42:53.499364 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb9fed-bdeb-4d69-9de8-b0815437ba31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:42:53.500035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb9fed-bdeb-4d69-9de8-b0815437ba31 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:42:53.500340 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb9fed-bdeb-4d69-9de8-b0815437ba31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:42:53.500622 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb9fed-bdeb-4d69-9de8-b0815437ba31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:42:53.508839 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb9fed-bdeb-4d69-9de8-b0815437ba31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:42:53.510351 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb9fed-bdeb-4d69-9de8-b0815437ba31 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:42:53.518405 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1374/2754] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:42:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:43:16.660792 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:43:16.663536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:16.717090 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf360e-7091-4581-ae0c-8500b41e92aa None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:43:16.721153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2d3d-912f-4fad-ba37-15e6b9689e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:43:16.721829 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2d3d-912f-4fad-ba37-15e6b9689e00 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:16.722265 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2d3d-912f-4fad-ba37-15e6b9689e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:16.722619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2d3d-912f-4fad-ba37-15e6b9689e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:16.725005 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2cee2d3d-912f-4fad-ba37-15e6b9689e00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:16.781716 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee2d3d-912f-4fad-ba37-15e6b9689e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:43:16.783199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee2d3d-912f-4fad-ba37-15e6b9689e00 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:43:16.792749 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1381/2755] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:43:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:43:23.528620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:23.529102 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:23.529216 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:23.546706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] MFA Rules not processed for user `109bd8f590ec434a9cc0326cbc13890a`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:43:23.547922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:23.555163 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1375/2756] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:43:29.504687 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:29.505191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:29.505292 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:29.523006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:43:29.524170 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:29.581279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1382/2757] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:43:29.628263 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:43:29.629681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:29.698136 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd1a9-2a8c-4551-8c56-105c76293b09 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:43:29.703110 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d03db-bf60-4af9-a9e5-f21f9172fd94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:43:29.703791 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d03db-bf60-4af9-a9e5-f21f9172fd94 service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:29.704072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d03db-bf60-4af9-a9e5-f21f9172fd94 service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:29.704346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d03db-bf60-4af9-a9e5-f21f9172fd94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:29.712775 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d03db-bf60-4af9-a9e5-f21f9172fd94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:43:29.714358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d03db-bf60-4af9-a9e5-f21f9172fd94 service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:43:29.722754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1376/2758] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:43:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:43:36.243779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:43:36.245338 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:36.338843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050c7b-8979-458b-bba3-7333a0523b26 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:43:36.344151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3072f8e-4953-4d2a-ae4f-35e547ab852d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c7f1498d7e4ef79977166d285e5e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:43:36.344972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072f8e-4953-4d2a-ae4f-35e547ab852d service placement] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:36.345261 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072f8e-4953-4d2a-ae4f-35e547ab852d service placement] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:36.345541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072f8e-4953-4d2a-ae4f-35e547ab852d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:36.348004 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d3072f8e-4953-4d2a-ae4f-35e547ab852d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:36.364650 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3072f8e-4953-4d2a-ae4f-35e547ab852d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:43:36.366605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3072f8e-4953-4d2a-ae4f-35e547ab852d service placement] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:43:36.377328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1383/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:43:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:43:43.924026 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c5c29-0c0f-4cce-8a9d-4f02e1e8a518 None None] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:43.924602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c5c29-0c0f-4cce-8a9d-4f02e1e8a518 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:43.924602 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c5c29-0c0f-4cce-8a9d-4f02e1e8a518 None None] PATH_INFO: `/` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:43.927060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1377/2760] 10.222.0.60 () {54 vars in 921 bytes} [Mon Feb 7 20:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 20:43:43.931887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b14101-855b-4dfe-a643-9ec97d6cb28e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:43.932414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b14101-855b-4dfe-a643-9ec97d6cb28e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:43.932572 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b14101-855b-4dfe-a643-9ec97d6cb28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:43.952025 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-76b14101-855b-4dfe-a643-9ec97d6cb28e None None] MFA Rules not processed for user `097a1d32d8fe4b4ca3231950712fa579`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:43:43.953332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-76b14101-855b-4dfe-a643-9ec97d6cb28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:44.037641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1384/2761] 10.222.0.60 () {58 vars in 1018 bytes} [Mon Feb 7 20:43:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:43:44.050128 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c5c29-0c0f-4cce-8a9d-4f02e1e8a518 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:43:44.052120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e26c5c29-0c0f-4cce-8a9d-4f02e1e8a518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:44.108182 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c5c29-0c0f-4cce-8a9d-4f02e1e8a518 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:43:44.111651 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d4a2ed97744c9fad6b44b5835e260f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:43:44.112772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:44.113052 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:44.113328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:44.123530 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:43:44.124980 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:43:44.137940 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1378/2762] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:43:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:43:45.664899 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968eeb-42a4-4706-8697-a1bb4cac9895 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:45.665377 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968eeb-42a4-4706-8697-a1bb4cac9895 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:45.665473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7968eeb-42a4-4706-8697-a1bb4cac9895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:45.682577 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a7968eeb-42a4-4706-8697-a1bb4cac9895 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:43:45.683779 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a7968eeb-42a4-4706-8697-a1bb4cac9895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:43:45.691014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1385/2763] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:43:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:43:45.702490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:43:45.713765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83cc4-1764-410e-bce4-c4b075041963 service glance] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:43:45.718640 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:43:45.719259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:43:45.719570 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:43:45.719874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:43:45.728408 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:43:45.729965 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:43:45.737881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1379/2764] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:43:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:44:01.701342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:01.701872 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:01.701979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:01.719793 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:01.720979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:01.728740 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1386/2765] 10.222.0.60 () {58 vars in 967 bytes} [Mon Feb 7 20:44:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:44:01.741146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:01.751404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cfd0c-44ff-4492-9da1-44b02a5f2ba7 service swift] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:01.757000 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:01.757574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:01.757857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:01.758138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:01.766044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:01.767783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:01.778098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1380/2766] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:44:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:44:31.306374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:31.308030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:31.378423 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff8a44-f80a-4312-80d9-2e4b6a7142fa None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:31.382933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:31.383820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:31.384103 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:31.384380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] PATH_INFO: `/v3/users/fc907dd5ef0548ff84bee7c8d7e4ae0f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:31.385584 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc907dd5ef0548ff84bee7c8d7e4ae0f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:31.387534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:31.430747 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc907dd5ef0548ff84bee7c8d7e4ae0f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.437979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc907dd5ef0548ff84bee7c8d7e4ae0f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.445586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc907dd5ef0548ff84bee7c8d7e4ae0f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.456991 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc907dd5ef0548ff84bee7c8d7e4ae0f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.457664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc907dd5ef0548ff84bee7c8d7e4ae0f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.463294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1387/2767] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:44:31 2022] DELETE /identity/v3/users/fc907dd5ef0548ff84bee7c8d7e4ae0f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:31.638715 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:31.648984 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb465d-a07c-4d0c-b2bb-029488cab914 service swift] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:31.703646 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:31.704486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:31.704768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:31.705044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] PATH_INFO: `/v3/projects/202b4de9f7f64b28b4b916cfb595f7f7` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:31.706263 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=202b4de9f7f64b28b4b916cfb595f7f7)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:31.708185 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:31.751811 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202b4de9f7f64b28b4b916cfb595f7f7', 'request_id': 'req-e3d11897-fc83-4659-9065-162faa8bd5cc'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.757675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202b4de9f7f64b28b4b916cfb595f7f7', 'request_id': 'req-e3d11897-fc83-4659-9065-162faa8bd5cc'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.763013 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202b4de9f7f64b28b4b916cfb595f7f7', 'request_id': 'req-e3d11897-fc83-4659-9065-162faa8bd5cc'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.776346 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] The token cache is being invalidate because project 202b4de9f7f64b28b4b916cfb595f7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:44:31.776631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.777245 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.778734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1381/2768] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:44:31 2022] DELETE /identity/v3/projects/202b4de9f7f64b28b4b916cfb595f7f7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:31.782719 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:31.784632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:31.797422 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cb44-fd65-4429-9216-83df0c21da43 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:31.850943 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:31.851840 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:31.852130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:31.852411 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] PATH_INFO: `/v3/users/67685d0be5cd4c69bbc14bf183cf27e0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:31.853616 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67685d0be5cd4c69bbc14bf183cf27e0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:31.855562 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:31.899701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67685d0be5cd4c69bbc14bf183cf27e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.906587 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67685d0be5cd4c69bbc14bf183cf27e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.913705 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67685d0be5cd4c69bbc14bf183cf27e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.925647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67685d0be5cd4c69bbc14bf183cf27e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.926280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67685d0be5cd4c69bbc14bf183cf27e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:31.932034 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1388/2769] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:44:31 2022] DELETE /identity/v3/users/67685d0be5cd4c69bbc14bf183cf27e0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:32.097042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:32.098523 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:32.115720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d11897-fc83-4659-9065-162faa8bd5cc admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:32.170739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:32.171619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:32.171898 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:32.172190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] PATH_INFO: `/v3/projects/ea8adb862e35410c95f2f0123b60b4da` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:32.173338 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8adb862e35410c95f2f0123b60b4da)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:32.175243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:32.218618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8adb862e35410c95f2f0123b60b4da', 'request_id': 'req-09cdacd4-f685-4ab4-b328-2ff45efaf904'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:32.224973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8adb862e35410c95f2f0123b60b4da', 'request_id': 'req-09cdacd4-f685-4ab4-b328-2ff45efaf904'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:32.230279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8adb862e35410c95f2f0123b60b4da', 'request_id': 'req-09cdacd4-f685-4ab4-b328-2ff45efaf904'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:32.241830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] The token cache is being invalidate because project ea8adb862e35410c95f2f0123b60b4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:44:32.242117 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:32.242721 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:32.244257 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1382/2770] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:44:32 2022] DELETE /identity/v3/projects/ea8adb862e35410c95f2f0123b60b4da => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:36.037308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:36.038689 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:36.092832 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989980ae-f847-4869-a63c-456828f73bc5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:36.138849 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:36.139521 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:36.139809 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:36.140088 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:36.141873 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:36.197188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:36.198618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:36.207336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1389/2771] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:44:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:44:42.990716 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:42.992267 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:43.047161 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdacd4-f685-4ab4-b328-2ff45efaf904 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:43.051202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:43.051870 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:43.052154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:43.052429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:43.054132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:43.117095 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:43.118550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:43.128056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1383/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:44:46.243911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:46.245894 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:46.261187 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f74ad-5ee1-4e80-8e47-8c187465d5c7 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:46.265664 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:46.266528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:46.266811 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:46.267092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] PATH_INFO: `/v3/users/29fc8e4443914c889245777419348bcf` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:46.268353 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fc8e4443914c889245777419348bcf)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:46.270249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:46.325954 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fc8e4443914c889245777419348bcf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.336133 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fc8e4443914c889245777419348bcf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.343765 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fc8e4443914c889245777419348bcf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.356986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fc8e4443914c889245777419348bcf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.357921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ec4418ec-f83b-4f18-b404-19631bf07339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fc8e4443914c889245777419348bcf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.364501 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1390/2773] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:44:46 2022] DELETE /identity/v3/users/29fc8e4443914c889245777419348bcf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:46.550369 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:46.559954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943e1cf-7551-4fef-b19d-ce9e5d4ee7a8 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:46.614426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:46.615268 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:46.615580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:46.615858 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] PATH_INFO: `/v3/projects/2185d4e79c4947b6869c2dff85759513` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:46.617027 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2185d4e79c4947b6869c2dff85759513)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:46.618947 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:46.664305 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2185d4e79c4947b6869c2dff85759513', 'request_id': 'req-9d4a3e66-12c4-4412-af3e-61b90f8ec618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.670011 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2185d4e79c4947b6869c2dff85759513', 'request_id': 'req-9d4a3e66-12c4-4412-af3e-61b90f8ec618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.675379 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2185d4e79c4947b6869c2dff85759513', 'request_id': 'req-9d4a3e66-12c4-4412-af3e-61b90f8ec618'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.686806 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] The token cache is being invalidate because project 2185d4e79c4947b6869c2dff85759513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:44:46.687098 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.687821 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-9d4a3e66-12c4-4412-af3e-61b90f8ec618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:46.689574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1384/2774] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:44:46 2022] DELETE /identity/v3/projects/2185d4e79c4947b6869c2dff85759513 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:46.696199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d72c7-0002-413f-8b75-cd1bde379a67 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:46.696484 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d72c7-0002-413f-8b75-cd1bde379a67 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:46.696764 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d72c7-0002-413f-8b75-cd1bde379a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:46.714817 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5f8d72c7-0002-413f-8b75-cd1bde379a67 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:46.716036 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5f8d72c7-0002-413f-8b75-cd1bde379a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:46.776682 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1391/2775] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:44:46.784507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3da42-60a2-4fec-87ac-14d4394b508f None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:46.784805 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3da42-60a2-4fec-87ac-14d4394b508f None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:46.785086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3da42-60a2-4fec-87ac-14d4394b508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:46.802780 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-94d3da42-60a2-4fec-87ac-14d4394b508f None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:46.804139 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-94d3da42-60a2-4fec-87ac-14d4394b508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:46.812318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1385/2776] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:44:46.817064 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d72c7-0002-413f-8b75-cd1bde379a67 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:46.826424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d72c7-0002-413f-8b75-cd1bde379a67 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:46.831738 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:46.832388 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:46.832670 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:46.832950 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:46.833702 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:44:46.834002 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:46.835631 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:46.846771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1392/2777] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:44:46.850885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3da42-60a2-4fec-87ac-14d4394b508f None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:46.859933 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3da42-60a2-4fec-87ac-14d4394b508f None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:46.864529 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:46.865165 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:46.865445 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:46.865719 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:46.866426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:46.868344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:46.895218 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1386/2778] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:44:46 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:44:46.899336 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:46.909709 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91629-1b53-4b08-8b17-8ba5544c733e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:46.962233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:46.962818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:46.963098 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:46.963372 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:46.964096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:46.965976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:46.985031 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1393/2779] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:44:46 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:44:46.989739 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:47.000106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431f1a-ff1e-4a78-8e56-b62c5da8e3d8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:47.004736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:47.005391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:47.005682 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:47.005966 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:47.006706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:47.008330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:47.018262 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1387/2780] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:44:47.021929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:47.031830 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdd37d-8a71-4330-ab7d-60d1fd6a01ee admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:47.036976 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d4999-4616-43a4-bcd9-9af882bf663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:47.037626 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4999-4616-43a4-bcd9-9af882bf663c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:47.037914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4999-4616-43a4-bcd9-9af882bf663c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:47.038193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d4999-4616-43a4-bcd9-9af882bf663c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:47.038928 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d4999-4616-43a4-bcd9-9af882bf663c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:47.040567 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d4999-4616-43a4-bcd9-9af882bf663c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:47.050816 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1394/2781] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:44:47.054752 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:47.064430 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee2705-b437-4d0d-ae49-dc54042e7cac admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:47.068922 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:47.069776 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:47.070056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:47.070330 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] PATH_INFO: `/v3/projects/bf7e752f6a144f98b5715f65431ed40c/users/2aec6ce609704aa8bf0e90aa292c4578/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:47.085693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7e752f6a144f98b5715f65431ed40c, user_id=2aec6ce609704aa8bf0e90aa292c4578, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:47.088313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:47.101381 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1388/2782] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:44:47 2022] PUT /identity/v3/projects/bf7e752f6a144f98b5715f65431ed40c/users/2aec6ce609704aa8bf0e90aa292c4578/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:47.111226 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8a8af-867a-425e-980b-20e61ce43195 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:47.111618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8a8af-867a-425e-980b-20e61ce43195 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:47.111971 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8a8af-867a-425e-980b-20e61ce43195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:47.137528 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-95d8a8af-867a-425e-980b-20e61ce43195 None None] MFA Rules not processed for user `2aec6ce609704aa8bf0e90aa292c4578`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:47.138736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-95d8a8af-867a-425e-980b-20e61ce43195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:47.199311 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1395/2783] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:44:47.210522 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:47.212308 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:47.281807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf7db8-dec2-44eb-a07e-1022122ebbd0 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:47.287912 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27359-b751-416a-99e7-aa0b162187ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:47.288556 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27359-b751-416a-99e7-aa0b162187ff service nova] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:47.288840 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27359-b751-416a-99e7-aa0b162187ff service nova] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:47.289119 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27359-b751-416a-99e7-aa0b162187ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:47.296865 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27359-b751-416a-99e7-aa0b162187ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:47.298484 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27359-b751-416a-99e7-aa0b162187ff service nova] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:47.307060 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1389/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:44:55.501927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8a8af-867a-425e-980b-20e61ce43195 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:55.562470 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8a8af-867a-425e-980b-20e61ce43195 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:55.567601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:55.568460 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:55.568745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:55.569071 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] PATH_INFO: `/v3/users/2aec6ce609704aa8bf0e90aa292c4578` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:55.570267 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aec6ce609704aa8bf0e90aa292c4578)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:55.572200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:55.617356 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aec6ce609704aa8bf0e90aa292c4578'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:55.624859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aec6ce609704aa8bf0e90aa292c4578'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:55.632510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aec6ce609704aa8bf0e90aa292c4578'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:55.644193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aec6ce609704aa8bf0e90aa292c4578'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:55.644821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aec6ce609704aa8bf0e90aa292c4578'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:55.650843 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1396/2785] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:44:55 2022] DELETE /identity/v3/users/2aec6ce609704aa8bf0e90aa292c4578 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:55.655368 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:55.655892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:55.656022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:55.672904 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:55.674094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:55.734342 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1390/2786] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:44:55.744496 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:55.745921 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:55.803896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562387d8-6385-4128-9b51-0c953f6eeb37 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:55.807606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028bb56-998e-41a9-a5cc-bb6fbae9f784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:55.808251 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bb56-998e-41a9-a5cc-bb6fbae9f784 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:55.808538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bb56-998e-41a9-a5cc-bb6fbae9f784 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:55.808820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028bb56-998e-41a9-a5cc-bb6fbae9f784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:55.817862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028bb56-998e-41a9-a5cc-bb6fbae9f784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:55.819285 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028bb56-998e-41a9-a5cc-bb6fbae9f784 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:55.828586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1397/2787] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:44:56.088434 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.089906 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:56.101978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303649f-c4e8-436b-8c59-ee849ccca7d5 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.113575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.114445 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.114812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.115094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] PATH_INFO: `/v3/projects/bf7e752f6a144f98b5715f65431ed40c` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.116332 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7e752f6a144f98b5715f65431ed40c)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.118234 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.164471 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7e752f6a144f98b5715f65431ed40c', 'request_id': 'req-b4b6619b-bb99-491e-8571-b5e7740f9b4c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:56.170440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7e752f6a144f98b5715f65431ed40c', 'request_id': 'req-b4b6619b-bb99-491e-8571-b5e7740f9b4c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:56.175749 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7e752f6a144f98b5715f65431ed40c', 'request_id': 'req-b4b6619b-bb99-491e-8571-b5e7740f9b4c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:56.187115 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] The token cache is being invalidate because project bf7e752f6a144f98b5715f65431ed40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:44:56.187415 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:56.188046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-b4b6619b-bb99-491e-8571-b5e7740f9b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:44:56.189560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1391/2788] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:44:56 2022] DELETE /identity/v3/projects/bf7e752f6a144f98b5715f65431ed40c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:56.195429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40290b8-0367-4935-bfaa-3b4ea0776340 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.195847 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40290b8-0367-4935-bfaa-3b4ea0776340 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.196239 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40290b8-0367-4935-bfaa-3b4ea0776340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.214322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f40290b8-0367-4935-bfaa-3b4ea0776340 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:56.215579 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f40290b8-0367-4935-bfaa-3b4ea0776340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:56.271788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1398/2789] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:44:56.279712 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46290-d160-484b-8c55-8c54194f91a6 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.280005 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46290-d160-484b-8c55-8c54194f91a6 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.280287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf46290-d160-484b-8c55-8c54194f91a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.298574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-edf46290-d160-484b-8c55-8c54194f91a6 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:56.299800 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-edf46290-d160-484b-8c55-8c54194f91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:56.307625 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1392/2790] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:44:56.311597 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40290b8-0367-4935-bfaa-3b4ea0776340 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.321099 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40290b8-0367-4935-bfaa-3b4ea0776340 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.325820 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.326472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.326756 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.327037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.327841 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:44:56.328151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.329756 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.341538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1399/2791] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:44:56.345662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46290-d160-484b-8c55-8c54194f91a6 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.355231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf46290-d160-484b-8c55-8c54194f91a6 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.359807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.360443 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.360726 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.361006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.361730 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.363605 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.387671 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1393/2792] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:44:56 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:44:56.391662 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.402500 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a192581-65ed-49a1-933a-ca49de7dd748 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.457594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.458183 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.458466 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.458745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.459480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.461379 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.480784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1400/2793] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:44:56 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:44:56.484876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.494750 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafa1db-f135-4ca6-a48a-f4a03a1636ad admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.499264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.500014 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.500299 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.500577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.501313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.503418 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.513395 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1394/2794] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:44:56.517468 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.527988 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ed2e-0f87-458f-99c6-d18203117249 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.534127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3758c-408e-4a8b-bee4-64180eae5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.534955 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3758c-408e-4a8b-bee4-64180eae5922 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.535241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3758c-408e-4a8b-bee4-64180eae5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.535550 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3758c-408e-4a8b-bee4-64180eae5922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.536289 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3758c-408e-4a8b-bee4-64180eae5922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.537887 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3758c-408e-4a8b-bee4-64180eae5922 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.547787 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1401/2795] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:44:56.551982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.563067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b523-0697-4ab6-b067-63d1c3d4cd24 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.568248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.569120 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.569527 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.569823 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] PATH_INFO: `/v3/projects/b7e10963dbcc4bcbaa767f0da714fccd/users/05e0874964a347a791169809fab06560/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.584486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e10963dbcc4bcbaa767f0da714fccd, user_id=05e0874964a347a791169809fab06560, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.587107 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.599409 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1395/2796] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:44:56 2022] PUT /identity/v3/projects/b7e10963dbcc4bcbaa767f0da714fccd/users/05e0874964a347a791169809fab06560/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:56.610586 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dddc8-c064-49d2-8c95-c5cd8ddc1f98 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.610881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dddc8-c064-49d2-8c95-c5cd8ddc1f98 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.611161 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dddc8-c064-49d2-8c95-c5cd8ddc1f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.637319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bb5dddc8-c064-49d2-8c95-c5cd8ddc1f98 None None] MFA Rules not processed for user `05e0874964a347a791169809fab06560`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:56.638530 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bb5dddc8-c064-49d2-8c95-c5cd8ddc1f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:56.699231 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1402/2797] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:44:56.703693 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.761973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e88e7-094e-4378-8344-6bc979863649 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.766643 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.767323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.767637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.768548 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.769235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.771149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.797099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1396/2798] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:44:56 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:44:56.801632 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dddc8-c064-49d2-8c95-c5cd8ddc1f98 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.812188 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dddc8-c064-49d2-8c95-c5cd8ddc1f98 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.866673 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.867349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.867666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.867946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.868669 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.870585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.890227 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1403/2799] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:44:56 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:44:56.894219 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.904483 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1e75-d2b5-45f0-a516-aaeb0588c017 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.909310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.910152 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.910439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.910720 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.911512 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.913097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.923158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1397/2800] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:44:56.927691 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.937606 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a3a72-02c5-4a49-8806-08dae9a95b33 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:56.943027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:56.943929 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:56.944215 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:56.944497 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] PATH_INFO: `/v3/projects/ba9d3e4c18d64c168c7716dd2af25c57/users/4e2bee38768a43fb9f6b0f2bb9ea56b4/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:56.960194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9d3e4c18d64c168c7716dd2af25c57, user_id=4e2bee38768a43fb9f6b0f2bb9ea56b4, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:56.962844 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:56.974941 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1404/2801] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:44:56 2022] PUT /identity/v3/projects/ba9d3e4c18d64c168c7716dd2af25c57/users/4e2bee38768a43fb9f6b0f2bb9ea56b4/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:56.978863 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:56.988954 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d782f-3cde-4f8f-9eac-018c5bd99a93 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:57.042808 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9b7e0-66d2-458b-946b-30959a51c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:57.043412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b7e0-66d2-458b-946b-30959a51c766 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:57.043698 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b7e0-66d2-458b-946b-30959a51c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:57.043973 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9b7e0-66d2-458b-946b-30959a51c766 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:57.044695 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9b7e0-66d2-458b-946b-30959a51c766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:57.046279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9b7e0-66d2-458b-946b-30959a51c766 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:57.056232 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1398/2802] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:44:57.060380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:57.071082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17722ea0-538a-4c6f-b7ac-f6f10c5d7023 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:57.075623 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:57.076513 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:57.076788 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:57.077065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] PATH_INFO: `/v3/projects/ba9d3e4c18d64c168c7716dd2af25c57/users/4e2bee38768a43fb9f6b0f2bb9ea56b4/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:57.079047 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9d3e4c18d64c168c7716dd2af25c57, user_id=4e2bee38768a43fb9f6b0f2bb9ea56b4, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:57.081700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:57.091472 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1405/2803] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:44:57 2022] PUT /identity/v3/projects/ba9d3e4c18d64c168c7716dd2af25c57/users/4e2bee38768a43fb9f6b0f2bb9ea56b4/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:44:57.101412 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d577e-7759-44ed-ae07-a7a3be4e4b70 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:57.101703 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d577e-7759-44ed-ae07-a7a3be4e4b70 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:57.101981 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d577e-7759-44ed-ae07-a7a3be4e4b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:57.128615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-b46d577e-7759-44ed-ae07-a7a3be4e4b70 None None] MFA Rules not processed for user `4e2bee38768a43fb9f6b0f2bb9ea56b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:44:57.129798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-b46d577e-7759-44ed-ae07-a7a3be4e4b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:57.195273 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1399/2804] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:44:57.205141 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:57.206876 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:44:57.260724 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35b7c5-bea1-4570-965d-6ee1c7dcb1ff admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:57.264320 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:57.264948 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:57.265230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:57.265502 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:57.274263 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:57.275969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:57.285510 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1406/2805] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:44:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:44:57.352086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d577e-7759-44ed-ae07-a7a3be4e4b70 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:44:57.361450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d577e-7759-44ed-ae07-a7a3be4e4b70 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:44:57.365662 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba6299-4615-4b9c-9367-c65caa3c341d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:44:57.366295 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6299-4615-4b9c-9367-c65caa3c341d service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:44:57.366575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6299-4615-4b9c-9367-c65caa3c341d service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:44:57.366851 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba6299-4615-4b9c-9367-c65caa3c341d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:44:57.420067 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba6299-4615-4b9c-9367-c65caa3c341d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:44:57.421487 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba6299-4615-4b9c-9367-c65caa3c341d service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:44:57.430604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1400/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:44:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:07.065536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:07.124452 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5daa4f-ec55-47de-9679-bc043cfa687b service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:07.128969 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:07.129813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:07.130091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:07.130361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] PATH_INFO: `/v3/users/05e0874964a347a791169809fab06560` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:07.131598 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e0874964a347a791169809fab06560)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:07.133487 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:07.178110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e0874964a347a791169809fab06560'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.185244 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e0874964a347a791169809fab06560'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.191918 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e0874964a347a791169809fab06560'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.202871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e0874964a347a791169809fab06560'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.203534 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e0874964a347a791169809fab06560'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.211054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1407/2807] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:45:07 2022] DELETE /identity/v3/users/05e0874964a347a791169809fab06560 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:07.215524 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:07.216002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:07.216101 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:07.233433 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:07.234618 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:07.290507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1401/2808] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:07.300601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:07.301975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:07.356342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b407b-e3d0-44ae-9134-be14a4627737 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:07.359959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:07.360594 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:07.360878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:07.361199 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:07.370019 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:07.371547 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:07.380771 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1408/2809] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:07.634638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:07.636068 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:07.648451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f2c4-0077-4130-a91b-d6b56ae94e4e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:07.654112 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:07.654974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:07.655264 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:07.655580 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] PATH_INFO: `/v3/projects/b7e10963dbcc4bcbaa767f0da714fccd` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:07.656793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e10963dbcc4bcbaa767f0da714fccd)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:07.659282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:07.708598 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e10963dbcc4bcbaa767f0da714fccd', 'request_id': 'req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.714462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e10963dbcc4bcbaa767f0da714fccd', 'request_id': 'req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.719896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e10963dbcc4bcbaa767f0da714fccd', 'request_id': 'req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.734603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] The token cache is being invalidate because project b7e10963dbcc4bcbaa767f0da714fccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:07.734892 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.735550 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.737696 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1402/2810] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:07 2022] DELETE /identity/v3/projects/b7e10963dbcc4bcbaa767f0da714fccd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:07.741770 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:07.751167 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6057c3e-967b-460f-867d-6bfbb3890ae3 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:07.805762 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:07.806627 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:07.806912 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:07.807193 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] PATH_INFO: `/v3/users/4e2bee38768a43fb9f6b0f2bb9ea56b4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:07.808421 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2bee38768a43fb9f6b0f2bb9ea56b4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:07.810344 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:07.854332 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2bee38768a43fb9f6b0f2bb9ea56b4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.861927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2bee38768a43fb9f6b0f2bb9ea56b4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.868671 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2bee38768a43fb9f6b0f2bb9ea56b4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.880238 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2bee38768a43fb9f6b0f2bb9ea56b4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.881027 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e70bf857-c431-4231-bfae-c690247d369d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2bee38768a43fb9f6b0f2bb9ea56b4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:07.886875 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1409/2811] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:45:07 2022] DELETE /identity/v3/users/4e2bee38768a43fb9f6b0f2bb9ea56b4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:08.141675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.143774 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:08.157155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc9ed0-20ce-4a95-99e6-73f77e6678f9 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.212186 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.213033 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.213313 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.213588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] PATH_INFO: `/v3/projects/ba9d3e4c18d64c168c7716dd2af25c57` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.214753 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9d3e4c18d64c168c7716dd2af25c57)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.216673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.261557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9d3e4c18d64c168c7716dd2af25c57', 'request_id': 'req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:08.267784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9d3e4c18d64c168c7716dd2af25c57', 'request_id': 'req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:08.273053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9d3e4c18d64c168c7716dd2af25c57', 'request_id': 'req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:08.284486 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] The token cache is being invalidate because project ba9d3e4c18d64c168c7716dd2af25c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:08.284769 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:08.285387 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-1ce196e4-9edb-4319-89b1-aa2a0ef3326c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:08.286907 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1403/2812] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:08 2022] DELETE /identity/v3/projects/ba9d3e4c18d64c168c7716dd2af25c57 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:08.293409 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967944-b63d-4396-92f7-e22da11cecef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.293888 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967944-b63d-4396-92f7-e22da11cecef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.293985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967944-b63d-4396-92f7-e22da11cecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.311480 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-33967944-b63d-4396-92f7-e22da11cecef None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:08.312675 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-33967944-b63d-4396-92f7-e22da11cecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:08.368819 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1410/2813] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:45:08.377326 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924945d8-173d-41ad-b9b7-72b9a4b6559e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.377615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924945d8-173d-41ad-b9b7-72b9a4b6559e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.377891 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924945d8-173d-41ad-b9b7-72b9a4b6559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.395902 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-924945d8-173d-41ad-b9b7-72b9a4b6559e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:08.397018 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-924945d8-173d-41ad-b9b7-72b9a4b6559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:08.405030 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1404/2814] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:08.409557 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33967944-b63d-4396-92f7-e22da11cecef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.418935 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33967944-b63d-4396-92f7-e22da11cecef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.423538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.424181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.424465 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.424742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.425478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:45:08.425784 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.427365 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.438328 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1411/2815] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:45:08.442962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924945d8-173d-41ad-b9b7-72b9a4b6559e None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.451999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924945d8-173d-41ad-b9b7-72b9a4b6559e None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.457319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.457958 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.458238 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.458513 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.459235 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.461138 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.484766 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1405/2816] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:45:08 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:45:08.488831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.498537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d83c-ab97-40fe-a678-04607babbc22 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.552436 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.553091 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.553373 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.553647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.554343 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.556397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.574726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1412/2817] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:45:08 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:45:08.578967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.589612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794292d4-fe24-4f7a-a159-a8c9f44c1bb4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.595075 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.595846 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.596127 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.596404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.597150 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.598746 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.609229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1406/2818] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:08.613174 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.622914 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6072bad-dbe2-4ee0-ab35-5e8e6b05dac6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.628096 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba9ba0-ccbd-49f0-8776-29316c4013e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.628745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9ba0-ccbd-49f0-8776-29316c4013e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.629030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9ba0-ccbd-49f0-8776-29316c4013e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.629309 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9ba0-ccbd-49f0-8776-29316c4013e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.630059 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9ba0-ccbd-49f0-8776-29316c4013e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.631683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9ba0-ccbd-49f0-8776-29316c4013e1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.641280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1413/2819] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:08.645648 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.655650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e4916-6a13-4689-abe3-93cdd21f83b1 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.660164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.661017 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.661306 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.661574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] PATH_INFO: `/v3/projects/1789fe16f1c04712946dc6b79a486c53/users/ea4b3c1340574f128439ab51c5d55abe/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.675650 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1789fe16f1c04712946dc6b79a486c53, user_id=ea4b3c1340574f128439ab51c5d55abe, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.678251 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.691565 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1407/2820] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:45:08 2022] PUT /identity/v3/projects/1789fe16f1c04712946dc6b79a486c53/users/ea4b3c1340574f128439ab51c5d55abe/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:08.701680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456f1a1-a80d-434b-9fcd-29e3a87cd90a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.701975 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456f1a1-a80d-434b-9fcd-29e3a87cd90a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.702259 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456f1a1-a80d-434b-9fcd-29e3a87cd90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.728175 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b456f1a1-a80d-434b-9fcd-29e3a87cd90a None None] MFA Rules not processed for user `ea4b3c1340574f128439ab51c5d55abe`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:08.729368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b456f1a1-a80d-434b-9fcd-29e3a87cd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:08.790814 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1414/2821] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:08.795175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.853619 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109b247-7a50-44ab-b5c8-11dc5c263995 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.858307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.858957 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.859241 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.859575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.860286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.862709 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.887384 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1408/2822] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:45:08 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:45:08.891438 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456f1a1-a80d-434b-9fcd-29e3a87cd90a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.902087 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456f1a1-a80d-434b-9fcd-29e3a87cd90a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.955593 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.956194 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.956571 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.956744 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.957442 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:08.959404 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:08.977344 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1415/2823] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:45:08 2022] POST /identity/v3/users => generated 297 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:45:08.981259 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:08.991868 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff3540-c460-40f7-accf-def014503730 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:08.996459 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:08.997105 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:08.997397 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:08.997676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:08.998413 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.000056 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.010781 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1409/2824] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:09.014419 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.024039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e72fc-2ed8-41c7-849d-b8ce3c5491c3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.028898 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.029751 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.030030 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.030304 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] PATH_INFO: `/v3/projects/e4a6d2a329a6426bb6fffabdd6cffef7/users/49c6a64f32514ff4adcea2388e5b8884/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.045906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a6d2a329a6426bb6fffabdd6cffef7, user_id=49c6a64f32514ff4adcea2388e5b8884, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.049033 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.061067 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1416/2825] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:45:09 2022] PUT /identity/v3/projects/e4a6d2a329a6426bb6fffabdd6cffef7/users/49c6a64f32514ff4adcea2388e5b8884/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:45:09.065600 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.075282 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34e44-954f-4dfe-8894-d53b688665be admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.130394 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3160ca3-1535-4a1f-8d38-49ed1cda7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.131044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3160ca3-1535-4a1f-8d38-49ed1cda7cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.131328 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3160ca3-1535-4a1f-8d38-49ed1cda7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.131637 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3160ca3-1535-4a1f-8d38-49ed1cda7cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.132399 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3160ca3-1535-4a1f-8d38-49ed1cda7cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.134046 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3160ca3-1535-4a1f-8d38-49ed1cda7cf1 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.143344 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1410/2826] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:09.147349 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.157641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936fdc-4d92-41bb-92af-fd3db44fe29a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.162252 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.163118 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.163418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.163706 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] PATH_INFO: `/v3/projects/e4a6d2a329a6426bb6fffabdd6cffef7/users/49c6a64f32514ff4adcea2388e5b8884/roles/e8e367d2563945e8b9f3144d0babc9f4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.165772 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a6d2a329a6426bb6fffabdd6cffef7, user_id=49c6a64f32514ff4adcea2388e5b8884, role_id=e8e367d2563945e8b9f3144d0babc9f4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.168406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.179042 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1417/2827] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:45:09 2022] PUT /identity/v3/projects/e4a6d2a329a6426bb6fffabdd6cffef7/users/49c6a64f32514ff4adcea2388e5b8884/roles/e8e367d2563945e8b9f3144d0babc9f4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:09.189053 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b748-af7d-406b-b90d-b5a265e79456 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.190002 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b748-af7d-406b-b90d-b5a265e79456 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.190287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b748-af7d-406b-b90d-b5a265e79456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.215197 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-3057b748-af7d-406b-b90d-b5a265e79456 None None] MFA Rules not processed for user `49c6a64f32514ff4adcea2388e5b8884`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:09.216365 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3057b748-af7d-406b-b90d-b5a265e79456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:09.280081 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1411/2828] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:09.291209 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.292923 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:09.347074 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2f70c-ca79-409c-90a9-20a336e6a4f5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.350781 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.351431 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.351720 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.351998 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.360742 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.362777 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.371913 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1418/2829] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:09.646146 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b748-af7d-406b-b90d-b5a265e79456 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.655416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b748-af7d-406b-b90d-b5a265e79456 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.660723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c6a64f32514ff4adcea2388e5b8884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a6d2a329a6426bb6fffabdd6cffef7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.661359 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.661644 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.661950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.662675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:45:09.662982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.664626 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.675942 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1412/2830] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:45:09.680121 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.689249 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc252f-fa02-483b-90e0-9f29281e4dd0 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.693745 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c6a64f32514ff4adcea2388e5b8884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a6d2a329a6426bb6fffabdd6cffef7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.694378 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.694680 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.694946 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.695690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.697574 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.722242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1419/2831] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:45:09 2022] POST /identity/v3/projects => generated 354 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:45:09.726164 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.735704 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37315-5849-41bf-a01f-fc7bf7409b93 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.790097 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c6a64f32514ff4adcea2388e5b8884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a6d2a329a6426bb6fffabdd6cffef7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.790756 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.791042 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.791321 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.792082 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:45:09.792394 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.793978 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.805071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1413/2832] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:45:09.837601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:09.848386 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3d8b-e6e1-4cb2-a050-15744d678601 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:09.853092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49c6a64f32514ff4adcea2388e5b8884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a6d2a329a6426bb6fffabdd6cffef7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:09.853944 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:09.854233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:09.854536 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] PATH_INFO: `/v3/projects/6faec65c445441e697d1ee2027b5fc80` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:09.855920 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6faec65c445441e697d1ee2027b5fc80)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:09.857795 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:09.903473 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6faec65c445441e697d1ee2027b5fc80', 'request_id': 'req-ba365448-a058-4199-a16a-0481872d3062'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:09.910082 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6faec65c445441e697d1ee2027b5fc80', 'request_id': 'req-ba365448-a058-4199-a16a-0481872d3062'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:09.915286 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6faec65c445441e697d1ee2027b5fc80', 'request_id': 'req-ba365448-a058-4199-a16a-0481872d3062'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:09.926127 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] The token cache is being invalidate because project 6faec65c445441e697d1ee2027b5fc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:09.926414 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:09.927039 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ba365448-a058-4199-a16a-0481872d3062 tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:09.928661 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1420/2833] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:09 2022] DELETE /identity/v3/projects/6faec65c445441e697d1ee2027b5fc80 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:45:10.100022 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:10.101723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:10.163876 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b689b64-e42d-44d4-b1bf-25efade87d6d tempest-VolumeQuotaClassesTest-2074252575 tempest-VolumeQuotaClassesTest-2074252575-project-admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:10.215213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:10.216099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:10.216385 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:10.216655 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] PATH_INFO: `/v3/users/ea4b3c1340574f128439ab51c5d55abe` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:10.217833 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4b3c1340574f128439ab51c5d55abe)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:10.219765 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:10.262358 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4b3c1340574f128439ab51c5d55abe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.269575 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4b3c1340574f128439ab51c5d55abe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.281374 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4b3c1340574f128439ab51c5d55abe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.289349 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4b3c1340574f128439ab51c5d55abe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.289992 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4b3c1340574f128439ab51c5d55abe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.295676 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1414/2834] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:45:10 2022] DELETE /identity/v3/users/ea4b3c1340574f128439ab51c5d55abe => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:10.300812 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:10.301093 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:10.301368 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:10.318264 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:10.319478 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:10.373619 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1421/2835] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:10.383859 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:10.385263 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:10.439921 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5e99c-ff56-40fc-869f-f0e5f56da4c4 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:10.443562 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:10.444192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:10.444472 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:10.444748 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:10.453517 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:10.454963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:10.464151 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1415/2836] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:10.715585 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:10.717180 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:10.730342 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0439a-fae9-4394-9bcf-cd063c3d3b05 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:10.735065 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:10.737192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:10.737479 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:10.737933 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] PATH_INFO: `/v3/projects/1789fe16f1c04712946dc6b79a486c53` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:10.739168 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1789fe16f1c04712946dc6b79a486c53)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:10.741060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:10.786111 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1789fe16f1c04712946dc6b79a486c53', 'request_id': 'req-88809119-59cc-42ed-bc57-16039f2a09d5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.792874 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1789fe16f1c04712946dc6b79a486c53', 'request_id': 'req-88809119-59cc-42ed-bc57-16039f2a09d5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.798151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1789fe16f1c04712946dc6b79a486c53', 'request_id': 'req-88809119-59cc-42ed-bc57-16039f2a09d5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.809233 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] The token cache is being invalidate because project 1789fe16f1c04712946dc6b79a486c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:10.809455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.810073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.811607 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1422/2837] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:10 2022] DELETE /identity/v3/projects/1789fe16f1c04712946dc6b79a486c53 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:45:10.815842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:10.825315 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935e936-501b-4b76-a01e-36761d591e55 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:10.880284 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:10.881208 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:10.881492 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:10.881772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] PATH_INFO: `/v3/users/49c6a64f32514ff4adcea2388e5b8884` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:10.882999 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c6a64f32514ff4adcea2388e5b8884)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:10.884953 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:10.929485 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c6a64f32514ff4adcea2388e5b8884'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.936129 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c6a64f32514ff4adcea2388e5b8884'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.947490 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c6a64f32514ff4adcea2388e5b8884'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.954479 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c6a64f32514ff4adcea2388e5b8884'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.955172 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-2fa1f4d4-2d1f-4bdd-a997-7f571ca20cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c6a64f32514ff4adcea2388e5b8884'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:10.960856 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1416/2838] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:45:10 2022] DELETE /identity/v3/users/49c6a64f32514ff4adcea2388e5b8884 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:45:11.230455 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.233130 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:11.246315 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809119-59cc-42ed-bc57-16039f2a09d5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.303177 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.304058 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.304341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.304613 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] PATH_INFO: `/v3/projects/e4a6d2a329a6426bb6fffabdd6cffef7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.305786 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a6d2a329a6426bb6fffabdd6cffef7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.307696 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.351200 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a6d2a329a6426bb6fffabdd6cffef7', 'request_id': 'req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:11.357822 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a6d2a329a6426bb6fffabdd6cffef7', 'request_id': 'req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:11.362984 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a6d2a329a6426bb6fffabdd6cffef7', 'request_id': 'req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:11.373151 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] The token cache is being invalidate because project e4a6d2a329a6426bb6fffabdd6cffef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:11.373429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:11.374045 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-84e6d9ec-51ab-4ca5-9ca3-ddc418ff1a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:11.375537 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1423/2839] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:11 2022] DELETE /identity/v3/projects/e4a6d2a329a6426bb6fffabdd6cffef7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:11.383055 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43ab71-2751-4359-8c0e-327a530c1397 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.383509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43ab71-2751-4359-8c0e-327a530c1397 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.383652 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43ab71-2751-4359-8c0e-327a530c1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.401899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9f43ab71-2751-4359-8c0e-327a530c1397 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:11.403166 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9f43ab71-2751-4359-8c0e-327a530c1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:11.460560 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1417/2840] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:11.469821 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ad5a-9827-43fa-b07f-965a9ab14f0e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.470109 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ad5a-9827-43fa-b07f-965a9ab14f0e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.470457 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917ad5a-9827-43fa-b07f-965a9ab14f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.488150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2917ad5a-9827-43fa-b07f-965a9ab14f0e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:11.489361 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2917ad5a-9827-43fa-b07f-965a9ab14f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:11.497044 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1424/2841] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:11.500982 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43ab71-2751-4359-8c0e-327a530c1397 None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.510885 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43ab71-2751-4359-8c0e-327a530c1397 None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.515450 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.516094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.516377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.516654 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.517437 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:45:11.518231 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.519861 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.531515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1418/2842] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 20:45:11.535835 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ad5a-9827-43fa-b07f-965a9ab14f0e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.546864 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917ad5a-9827-43fa-b07f-965a9ab14f0e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.551565 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.552241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.552527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.552808 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.553508 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.555418 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.580488 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1425/2843] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:45:11 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 20:45:11.584564 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.594255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003314fd-6f93-43a2-a40d-b49263ca3a53 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.648059 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.648706 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.648987 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.649260 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] PATH_INFO: `/v3/users` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.650224 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.652159 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.675319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1419/2844] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:45:11 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:45:11.679448 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.690124 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373eacd-c337-40a7-a034-59e473fcb1a2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.698397 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.699051 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.699334 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.699641 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.700374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.701961 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.713846 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1426/2845] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:11.717733 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.727588 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7260e39-c43d-4f1b-b632-f01406adcefd admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.732132 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b13392-4eaa-40ed-ba38-2e473eaaa2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.732807 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b13392-4eaa-40ed-ba38-2e473eaaa2ff admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.733088 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b13392-4eaa-40ed-ba38-2e473eaaa2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.733367 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b13392-4eaa-40ed-ba38-2e473eaaa2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.734099 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b13392-4eaa-40ed-ba38-2e473eaaa2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.735754 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b13392-4eaa-40ed-ba38-2e473eaaa2ff admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.745154 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1420/2846] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:11.748982 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.759131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8d46c-c04d-4282-9eeb-8f9a9d1b053b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.764206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.765060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.765341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.765618 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] PATH_INFO: `/v3/projects/9ac9ac52f3c249549b55927cedad08c4/users/042a785b40d04919b17ed1ed2f5dd7e0/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.781341 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac9ac52f3c249549b55927cedad08c4, user_id=042a785b40d04919b17ed1ed2f5dd7e0, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.784089 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.796453 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1427/2847] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:45:11 2022] PUT /identity/v3/projects/9ac9ac52f3c249549b55927cedad08c4/users/042a785b40d04919b17ed1ed2f5dd7e0/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:45:11.801974 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4638f8b-0da9-45d5-99da-0c51490d845e None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.802391 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4638f8b-0da9-45d5-99da-0c51490d845e None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.802681 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4638f8b-0da9-45d5-99da-0c51490d845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.820768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-d4638f8b-0da9-45d5-99da-0c51490d845e None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:11.822023 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-d4638f8b-0da9-45d5-99da-0c51490d845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:11.878962 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1421/2848] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:11.888424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:11.890104 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:11.945686 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44018-6e13-43de-b58f-a7989487ff87 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:11.949258 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:11.949895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:11.950178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:11.950454 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:11.959271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:11.960726 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:11.970006 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1428/2849] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:12.542044 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef63a92-8077-4efa-ab10-0bd748f5dca0 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:12.542557 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef63a92-8077-4efa-ab10-0bd748f5dca0 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:12.542673 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef63a92-8077-4efa-ab10-0bd748f5dca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:12.569229 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-9ef63a92-8077-4efa-ab10-0bd748f5dca0 None None] MFA Rules not processed for user `042a785b40d04919b17ed1ed2f5dd7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:12.570559 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9ef63a92-8077-4efa-ab10-0bd748f5dca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:12.633820 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1422/2850] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:12.643683 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:12.645601 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:12.701499 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb9f7-f4b8-42db-8c8c-39db42ac69a1 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:12.705648 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:12.706293 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:12.706578 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:12.706855 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:12.715230 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:12.716700 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:12.726026 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1429/2851] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:14.045515 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30be5-1088-4b3d-8086-aba2ecf5389a None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:14.046007 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30be5-1088-4b3d-8086-aba2ecf5389a None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:14.046123 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30be5-1088-4b3d-8086-aba2ecf5389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:14.063784 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-06b30be5-1088-4b3d-8086-aba2ecf5389a None None] MFA Rules not processed for user `042a785b40d04919b17ed1ed2f5dd7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:14.064967 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-06b30be5-1088-4b3d-8086-aba2ecf5389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:14.071768 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1423/2852] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:20.394413 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:20.395909 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:20.407697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ec90e-89b7-4d27-9e00-b42c9a7fe774 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:20.413704 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035fe4b-feae-4b75-8c35-e08fd1b5f5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:20.414374 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035fe4b-feae-4b75-8c35-e08fd1b5f5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:20.414653 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035fe4b-feae-4b75-8c35-e08fd1b5f5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:20.414927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035fe4b-feae-4b75-8c35-e08fd1b5f5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:20.416694 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a035fe4b-feae-4b75-8c35-e08fd1b5f5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:20.490997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035fe4b-feae-4b75-8c35-e08fd1b5f5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:20.492371 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035fe4b-feae-4b75-8c35-e08fd1b5f5d7 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:20.503904 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1430/2853] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:22.056063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30be5-1088-4b3d-8086-aba2ecf5389a None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:22.066192 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30be5-1088-4b3d-8086-aba2ecf5389a None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:22.069736 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:22.070372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:22.070658 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:22.070936 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:22.072722 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:22.086376 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:22.087831 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:22.098628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1424/2854] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:25.842192 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:25.842666 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:25.842774 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:25.860050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] MFA Rules not processed for user `042a785b40d04919b17ed1ed2f5dd7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:25.861871 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:25.868736 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1431/2855] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:26.092624 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:26.101633 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db04042-e403-4115-8ed3-b147019d0555 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:26.105168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:26.105798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:26.106083 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:26.106361 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:26.108106 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:26.117290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:26.118712 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:26.126714 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1425/2856] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:26.440247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:26.442539 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:26.512939 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080662e-b35f-4190-9779-87fbfc582088 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:26.518507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c7f1498d7e4ef79977166d285e5e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:26.519153 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:26.519467 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:26.519753 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:26.521509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:26.533382 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:26.534963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:26.545014 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1432/2857] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:33.491539 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:33.499881 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4517b-b4a7-43e0-883f-eb5197524d85 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:33.503741 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:33.504442 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:33.504727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:33.505006 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:33.506783 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:33.519360 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:33.520793 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:33.531063 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1426/2858] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:45:40.143563 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:40.145222 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:40.158979 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e621b85-cf9b-4c86-984b-6db20b736343 service placement] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:40.163690 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:40.164493 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:40.164775 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:40.165050 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] PATH_INFO: `/v3/users/109bd8f590ec434a9cc0326cbc13890a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:40.166241 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109bd8f590ec434a9cc0326cbc13890a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:40.168186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:40.214078 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109bd8f590ec434a9cc0326cbc13890a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.220605 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109bd8f590ec434a9cc0326cbc13890a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.227150 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109bd8f590ec434a9cc0326cbc13890a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.238581 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109bd8f590ec434a9cc0326cbc13890a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.239272 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109bd8f590ec434a9cc0326cbc13890a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.245129 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1433/2859] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:45:40 2022] DELETE /identity/v3/users/109bd8f590ec434a9cc0326cbc13890a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:40.427318 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:40.442875 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8dd79-799e-406a-af45-2f961db2023b service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:40.507024 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:40.507979 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:40.508258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:40.508723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] PATH_INFO: `/v3/projects/a36697eb438d4c69909c3d32f2f92e77` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:40.509925 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36697eb438d4c69909c3d32f2f92e77)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:40.511872 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:40.557426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36697eb438d4c69909c3d32f2f92e77', 'request_id': 'req-80c639a3-d5db-4675-920a-c645018d2bbe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.563213 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36697eb438d4c69909c3d32f2f92e77', 'request_id': 'req-80c639a3-d5db-4675-920a-c645018d2bbe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.568455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36697eb438d4c69909c3d32f2f92e77', 'request_id': 'req-80c639a3-d5db-4675-920a-c645018d2bbe'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.580256 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] The token cache is being invalidate because project a36697eb438d4c69909c3d32f2f92e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:40.580537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.581145 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.582638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1427/2860] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:40 2022] DELETE /identity/v3/projects/a36697eb438d4c69909c3d32f2f92e77 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 20:45:40.586646 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:40.588054 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:40.601879 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b272d-8fdc-4b47-86f6-fd80bec46568 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:40.655647 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:40.656538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:40.656827 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:40.657110 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] PATH_INFO: `/v3/users/479cef86bc7e407aa4dddb31be966676` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:40.658919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=479cef86bc7e407aa4dddb31be966676)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:40.660861 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:40.706866 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479cef86bc7e407aa4dddb31be966676'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.714114 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479cef86bc7e407aa4dddb31be966676'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.720862 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479cef86bc7e407aa4dddb31be966676'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.732131 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479cef86bc7e407aa4dddb31be966676'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.732791 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7075782c-b831-425d-b205-60747495ad43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479cef86bc7e407aa4dddb31be966676'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:40.738447 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1434/2861] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:45:40 2022] DELETE /identity/v3/users/479cef86bc7e407aa4dddb31be966676 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:40.901948 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:40.903301 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:40.915900 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c639a3-d5db-4675-920a-c645018d2bbe admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:40.970209 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:40.970993 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:40.971276 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:40.971585 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] PATH_INFO: `/v3/projects/91ef4548605040e9af946d0b43a313bd` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:40.972836 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ef4548605040e9af946d0b43a313bd)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:40.974734 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:41.018383 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ef4548605040e9af946d0b43a313bd', 'request_id': 'req-dfa6096a-3581-45df-8d6a-fd31611d9e9b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:41.024160 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ef4548605040e9af946d0b43a313bd', 'request_id': 'req-dfa6096a-3581-45df-8d6a-fd31611d9e9b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:41.029609 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ef4548605040e9af946d0b43a313bd', 'request_id': 'req-dfa6096a-3581-45df-8d6a-fd31611d9e9b'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:41.040577 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] The token cache is being invalidate because project 91ef4548605040e9af946d0b43a313bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:41.040871 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:41.041481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:41.042950 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1428/2862] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:40 2022] DELETE /identity/v3/projects/91ef4548605040e9af946d0b43a313bd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:42.328838 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad238-35c2-4647-bace-7676bdebe51c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:42.329997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad238-35c2-4647-bace-7676bdebe51c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:42.329997 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad238-35c2-4647-bace-7676bdebe51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:42.346798 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6ecad238-35c2-4647-bace-7676bdebe51c None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:42.348009 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6ecad238-35c2-4647-bace-7676bdebe51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:42.402906 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1435/2863] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:45:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:42.448943 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:42.450339 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:42.518536 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6096a-3581-45df-8d6a-fd31611d9e9b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:42.523444 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:42.524086 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:42.524372 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:42.524916 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:42.532877 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:42.534460 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:42.542243 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1429/2864] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:45:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:45:57.173229 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:57.173713 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:57.173813 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:57.190957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:57.192181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:57.199206 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1436/2865] 10.222.0.60 () {58 vars in 967 bytes} [Mon Feb 7 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:57.211058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:57.221788 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d06a4-ef60-4034-bbec-ab7519e7f08d service swift] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:57.226690 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:57.227319 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:57.227628 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:57.227952 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:57.236455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:57.238170 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:57.250323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1430/2866] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:45:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:45:59.098957 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.100429 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:59.163117 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8e1b-b917-440a-9afd-8448360be3cf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.167649 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.168507 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.168789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.169069 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] PATH_INFO: `/v3/users/042a785b40d04919b17ed1ed2f5dd7e0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.170280 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042a785b40d04919b17ed1ed2f5dd7e0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.172247 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.215106 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042a785b40d04919b17ed1ed2f5dd7e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.223060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042a785b40d04919b17ed1ed2f5dd7e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.229754 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042a785b40d04919b17ed1ed2f5dd7e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.240896 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042a785b40d04919b17ed1ed2f5dd7e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.241546 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bac48787-b34a-4e86-9269-f9a642e22319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042a785b40d04919b17ed1ed2f5dd7e0'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.247181 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1437/2867] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:45:59 2022] DELETE /identity/v3/users/042a785b40d04919b17ed1ed2f5dd7e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:59.413873 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.427149 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951af5d-64aa-4ba6-9241-280758028bd6 service swift] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.481830 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.482675 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.482959 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.483236 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] PATH_INFO: `/v3/projects/9ac9ac52f3c249549b55927cedad08c4` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.484449 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac9ac52f3c249549b55927cedad08c4)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.486917 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.533111 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac9ac52f3c249549b55927cedad08c4', 'request_id': 'req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.538896 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac9ac52f3c249549b55927cedad08c4', 'request_id': 'req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.544045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac9ac52f3c249549b55927cedad08c4', 'request_id': 'req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.556071 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] The token cache is being invalidate because project 9ac9ac52f3c249549b55927cedad08c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:45:59.556377 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.556990 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-4ac1addc-b430-4ec1-ac9c-50fa0eb78f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:45:59.558507 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1431/2868] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:45:59 2022] DELETE /identity/v3/projects/9ac9ac52f3c249549b55927cedad08c4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:59.565681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdcbbe-de5b-4174-a2c2-adf6bc3a8892 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.565973 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdcbbe-de5b-4174-a2c2-adf6bc3a8892 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.566295 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdcbbe-de5b-4174-a2c2-adf6bc3a8892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.584186 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a6fdcbbe-de5b-4174-a2c2-adf6bc3a8892 None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:59.585380 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a6fdcbbe-de5b-4174-a2c2-adf6bc3a8892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:59.642148 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1438/2869] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 20:45:59.650249 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b89a4-148d-4431-8992-a41e590fc70c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.650537 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b89a4-148d-4431-8992-a41e590fc70c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.650819 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b89a4-148d-4431-8992-a41e590fc70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.668889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-2f9b89a4-148d-4431-8992-a41e590fc70c None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:45:59.670003 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-2f9b89a4-148d-4431-8992-a41e590fc70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:45:59.678451 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1432/2870] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:45:59.682358 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdcbbe-de5b-4174-a2c2-adf6bc3a8892 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.691789 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdcbbe-de5b-4174-a2c2-adf6bc3a8892 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.696329 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.696972 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.697257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.697538 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.698271 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 20:45:59.698580 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.700218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.711306 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1439/2871] 10.222.0.60 () {58 vars in 1152 bytes} [Mon Feb 7 20:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 20:45:59.715283 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b89a4-148d-4431-8992-a41e590fc70c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.724735 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b89a4-148d-4431-8992-a41e590fc70c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.729246 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.729874 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.730155 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.730426 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] PATH_INFO: `/v3/projects` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.731122 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.733031 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.757004 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1433/2872] 10.222.0.60 () {60 vars in 1152 bytes} [Mon Feb 7 20:45:59 2022] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:45:59.761147 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.771308 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a320cdc-a50a-47a1-9211-8e9e1fae0538 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.825548 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.826212 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.826602 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.826778 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.827505 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.829989 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.849859 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1440/2873] 10.222.0.60 () {60 vars in 1143 bytes} [Mon Feb 7 20:45:59 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 20:45:59.853680 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.863723 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f09d8-aed2-4eea-baa2-45de61fb180b admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.868310 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.868955 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.869233 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.869509 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.870253 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.871867 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.882429 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1434/2874] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:59.886294 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.896919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc06598-1f9f-4879-8238-2f5e6b3a33ef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.901919 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe943bc0-b4f7-4ad7-a622-bfeb0febeab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.902570 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943bc0-b4f7-4ad7-a622-bfeb0febeab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.902868 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943bc0-b4f7-4ad7-a622-bfeb0febeab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.903299 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943bc0-b4f7-4ad7-a622-bfeb0febeab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.904072 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe943bc0-b4f7-4ad7-a622-bfeb0febeab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.905681 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe943bc0-b4f7-4ad7-a622-bfeb0febeab3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.916881 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1441/2875] 10.222.0.60 () {58 vars in 1121 bytes} [Mon Feb 7 20:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 20:45:59.921286 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:45:59.932603 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b45a0b-64d7-4fd8-a94a-77ed26b152c8 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:45:59.937320 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:45:59.938187 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] REQUEST_METHOD: `PUT` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.938469 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.938744 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] PATH_INFO: `/v3/projects/763aabb2b1a74233b473f45c6f048ea1/users/668c1e4dae5442c0b6bf432a11164ad3/roles/6d0818e098ae461b8c0b30d4061e0f68` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:45:59.955439 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763aabb2b1a74233b473f45c6f048ea1, user_id=668c1e4dae5442c0b6bf432a11164ad3, role_id=6d0818e098ae461b8c0b30d4061e0f68)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:45:59.958058 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:45:59.971066 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1435/2876] 10.222.0.60 () {60 vars in 1482 bytes} [Mon Feb 7 20:45:59 2022] PUT /identity/v3/projects/763aabb2b1a74233b473f45c6f048ea1/users/668c1e4dae5442c0b6bf432a11164ad3/roles/6d0818e098ae461b8c0b30d4061e0f68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:45:59.981437 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c06c9-c3c8-48d3-9976-432e13951ec0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:45:59.981776 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c06c9-c3c8-48d3-9976-432e13951ec0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:45:59.982062 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c06c9-c3c8-48d3-9976-432e13951ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:00.008541 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-df2c06c9-c3c8-48d3-9976-432e13951ec0 None None] MFA Rules not processed for user `668c1e4dae5442c0b6bf432a11164ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:46:00.009750 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-df2c06c9-c3c8-48d3-9976-432e13951ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:00.071527 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1442/2877] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:45:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:46:00.081581 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:00.083202 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:00.136825 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63708a94-fad9-4b57-b72b-68b536b4e363 admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:00.140455 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cad98b2dc54f97a4d72b53b0946802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:00.141620 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:00.141905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:00.142190 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:00.150572 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:00.152037 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:00.161096 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1436/2878] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:46:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:46:01.478697 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:01.479218 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:01.479331 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:01.496223 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] MFA Rules not processed for user `668c1e4dae5442c0b6bf432a11164ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:46:01.497406 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:01.504207 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1443/2879] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:46:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:46:03.583141 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:03.584604 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:03.642440 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773f383-5b49-43a2-8d3a-dd610010b894 service cinder] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:03.646331 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e31d-7de3-4f9b-89e4-d83450f4095d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:03.647228 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e31d-7de3-4f9b-89e4-d83450f4095d service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:03.647612 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e31d-7de3-4f9b-89e4-d83450f4095d service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:03.647899 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e31d-7de3-4f9b-89e4-d83450f4095d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:03.650290 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-f732e31d-7de3-4f9b-89e4-d83450f4095d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:03.660729 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e31d-7de3-4f9b-89e4-d83450f4095d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:03.662168 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e31d-7de3-4f9b-89e4-d83450f4095d service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:03.670179 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1437/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:46:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:46:09.682518 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:09.683985 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:09.756003 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c88b5c-f874-442d-b4ec-20888c85688a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:09.761399 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097a1d32d8fe4b4ca3231950712fa579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:09.762037 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:09.762317 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:09.762590 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:09.764345 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:09.776652 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:09.778158 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:09.788959 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1444/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:46:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:46:13.902035 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ba8a1-c212-4ac6-a1dc-ec43b94159db None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:13.902481 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ba8a1-c212-4ac6-a1dc-ec43b94159db None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:13.902574 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ba8a1-c212-4ac6-a1dc-ec43b94159db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:13.920062 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-573ba8a1-c212-4ac6-a1dc-ec43b94159db None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:46:13.921255 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-573ba8a1-c212-4ac6-a1dc-ec43b94159db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:13.973307 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1438/2882] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:46:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:46:13.985857 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:13.987240 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:14.055288 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d1c5b-cd51-4223-8e6d-d096fb2f520c service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:14.060257 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:14.060895 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:14.061178 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:14.061462 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:14.069268 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:14.070831 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:14.079059 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1445/2883] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:46:14.563554 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3bc3-3f30-43cb-abdf-3f8e40c80aa3 None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:14.563842 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3bc3-3f30-43cb-abdf-3f8e40c80aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:14.564124 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3bc3-3f30-43cb-abdf-3f8e40c80aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:14.581727 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-3f0c3bc3-3f30-43cb-abdf-3f8e40c80aa3 None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:46:14.582888 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-3f0c3bc3-3f30-43cb-abdf-3f8e40c80aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:14.590079 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1439/2884] 10.222.0.60 () {58 vars in 967 bytes} [Mon Feb 7 20:46:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:46:14.601804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:14.612102 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610c243-0b54-4163-943c-5adecd689a1c service swift] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:14.617113 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:14.617739 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:14.618023 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:14.618302 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:14.626804 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:14.628424 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:14.636363 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1446/2885] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 20:46:14.820323 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce6c0d-7c12-4076-926c-d96acda9213b None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:14.820615 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce6c0d-7c12-4076-926c-d96acda9213b None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:14.820897 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce6c0d-7c12-4076-926c-d96acda9213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:14.837905 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-82ce6c0d-7c12-4076-926c-d96acda9213b None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:46:14.839072 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-82ce6c0d-7c12-4076-926c-d96acda9213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:14.846094 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1440/2886] 10.222.0.60 () {58 vars in 1009 bytes} [Mon Feb 7 20:46:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:46:14.857916 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:14.868882 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5087b13-5895-4d80-8256-db7d71bd7e10 service swift] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:14.874145 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:14.875319 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:14.875628 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:14.875902 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:14.883986 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:14.885542 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:14.893322 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1447/2887] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:46:15.192857 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd969-d966-44c4-b0c7-27a2053c4e8c None None] REQUEST_METHOD: `POST` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:15.193324 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd969-d966-44c4-b0c7-27a2053c4e8c None None] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:15.193416 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bd969-d966-44c4-b0c7-27a2053c4e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:15.210404 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.auth.core [None req-ff8bd969-d966-44c4-b0c7-27a2053c4e8c None None] MFA Rules not processed for user `aa7fcbf331b84fc498a96f46c25d1c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:46:15.211610 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-ff8bd969-d966-44c4-b0c7-27a2053c4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:15.219041 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1441/2888] 10.222.0.60 () {58 vars in 967 bytes} [Mon Feb 7 20:46:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:46:15.231176 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:15.244073 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60106e-7ed1-4556-bf30-6ae02f84115b service swift] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:15.249326 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369234-f7be-4f51-a27b-62d9f492d422 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db726cf28f948108256ecd707c33c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:15.249963 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369234-f7be-4f51-a27b-62d9f492d422 service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:15.250290 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369234-f7be-4f51-a27b-62d9f492d422 service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:15.250575 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369234-f7be-4f51-a27b-62d9f492d422 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:15.258878 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369234-f7be-4f51-a27b-62d9f492d422 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:15.260485 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369234-f7be-4f51-a27b-62d9f492d422 service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:15.268617 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1448/2889] 10.222.0.60 () {60 vars in 1384 bytes} [Mon Feb 7 20:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 20:46:17.227638 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd969-d966-44c4-b0c7-27a2053c4e8c None None] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:17.289289 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bd969-d966-44c4-b0c7-27a2053c4e8c None None] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:17.294386 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:17.295248 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:17.295641 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:17.296073 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] PATH_INFO: `/v3/users/668c1e4dae5442c0b6bf432a11164ad3` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:17.297354 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] RBAC: Authorizing `identity:delete_user(user_id=668c1e4dae5442c0b6bf432a11164ad3)` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:17.299279 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:17.345196 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668c1e4dae5442c0b6bf432a11164ad3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.351631 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668c1e4dae5442c0b6bf432a11164ad3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.362546 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668c1e4dae5442c0b6bf432a11164ad3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.368963 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668c1e4dae5442c0b6bf432a11164ad3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.369798 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.notifications [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668c1e4dae5442c0b6bf432a11164ad3'} {{(pid=79178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.375883 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1442/2890] 10.222.0.60 () {58 vars in 1223 bytes} [Mon Feb 7 20:46:17 2022] DELETE /identity/v3/users/668c1e4dae5442c0b6bf432a11164ad3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:46:17.380417 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:17.380911 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:17.381024 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:17.398242 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] MFA Rules not processed for user `3b224356d3c840b79f4741c06d6f81d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 20:46:17.399708 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:17.456060 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1449/2891] 10.222.0.60 () {58 vars in 957 bytes} [Mon Feb 7 20:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 20:46:17.465592 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:17.466926 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:17.521325 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6bba3-54b4-416c-8ff1-1fea9b15704a admin admin] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:17.525252 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b86cad4ee844bdeae28d8a07d8a49b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:17.525889 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:17.526175 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:17.526457 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:17.535287 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:17.536737 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:17.545997 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1443/2892] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 20:46:17.708279 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:46:17.709701 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:46:17.722191 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab2c2e-0293-44c9-b853-fd8ccd8bb0ef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:46:17.726818 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b224356d3c840b79f4741c06d6f81d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fd85593742943409724ee224daef15b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:46:17.727710 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:46:17.727994 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:46:17.728274 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] PATH_INFO: `/v3/projects/763aabb2b1a74233b473f45c6f048ea1` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:46:17.729477 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763aabb2b1a74233b473f45c6f048ea1)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:46:17.731509 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:46:17.776092 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763aabb2b1a74233b473f45c6f048ea1', 'request_id': 'req-0266bca8-a6de-4d4e-b7ef-641ffef00e47'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.783927 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763aabb2b1a74233b473f45c6f048ea1', 'request_id': 'req-0266bca8-a6de-4d4e-b7ef-641ffef00e47'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.789573 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763aabb2b1a74233b473f45c6f048ea1', 'request_id': 'req-0266bca8-a6de-4d4e-b7ef-641ffef00e47'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.800172 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] The token cache is being invalidate because project 763aabb2b1a74233b473f45c6f048ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 20:46:17.800458 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.801076 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0266bca8-a6de-4d4e-b7ef-641ffef00e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 20:46:17.802608 dv-cinder-828150-2-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1450/2893] 10.222.0.60 () {58 vars in 1232 bytes} [Mon Feb 7 20:46:17 2022] DELETE /identity/v3/projects/763aabb2b1a74233b473f45c6f048ea1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 20:48:42.100812 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] Authenticating user token {{(pid=79178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 20:48:42.102181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:48:42.233373 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5471-93d8-4cbe-b47b-21c25317f9b5 service neutron] Validating token access rules against request {{(pid=79178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 20:48:42.289258 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdde63-6aaf-4c51-892b-48792b80f71c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28c7f1498d7e4ef79977166d285e5e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13c8ea7455b0419f8bd1f58d40a6580e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 20:48:42.289895 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdde63-6aaf-4c51-892b-48792b80f71c service placement] REQUEST_METHOD: `GET` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 20:48:42.290181 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdde63-6aaf-4c51-892b-48792b80f71c service placement] SCRIPT_NAME: `/identity` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 20:48:42.290462 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdde63-6aaf-4c51-892b-48792b80f71c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 20:48:42.292240 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.fernet_utils [None req-85cdde63-6aaf-4c51-892b-48792b80f71c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 20:48:42.303158 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdde63-6aaf-4c51-892b-48792b80f71c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 20:48:42.304772 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdde63-6aaf-4c51-892b-48792b80f71c service placement] RBAC: Authorization granted {{(pid=79178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 20:48:42.315045 dv-cinder-828150-2-iscsi devstack@keystone.service[79178]: [pid: 79178|app: 0|req: 1444/2894] 10.222.0.60 () {60 vars in 1365 bytes} [Mon Feb 7 20:48:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)